[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:06 dist-test-slave-c12x krb5kdc[30469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:06 dist-test-slave-c12x krb5kdc[30469](info): set up 2 sockets
Aug 12 00:27:06 dist-test-slave-c12x krb5kdc[30469](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 00:27:08.080633 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:08 dist-test-slave-c12x krb5kdc[30469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:08.296052 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:44929
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:44929
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:08.649612 30487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:08.649941 30487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:08.650101 30487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:08.658308 30487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:08.658440 30487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:08.658595 30487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:08.658699 30487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:08.658787 30487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:08.669178 30487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:44929
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:44929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:08.670635 30487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:08.672081 30487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:08.684990 30492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:08.684935 30493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:08.684926 30495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:08.685837 30487 server_base.cc:1034] running on GCE node
I20260812 00:27:08.686681 30487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:08.688199 30487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:08.689427 30487 hybrid_clock.cc:648] HybridClock initialized: now 1786494428689337 us; error 80 us; skew 500 ppm
I20260812 00:27:08.689779 30487 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:08 dist-test-slave-c12x krb5kdc[30469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494428, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:08.693626 30487 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:08.695485 30487 webserver.cc:460] Webserver started at http://127.29.190.190:35609/ using document root <none> and password file <none>
I20260812 00:27:08.696257 30487 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:08.696401 30487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:08.696738 30487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:08.700169 30487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "754e1df8f43542239ecec077171c2215"
format_stamp: "Formatted at 2026-08-12 00:27:08 on dist-test-slave-c12x"
server_key: "b6f115ec925884f74878c7f4f178b89b"
server_key_iv: "b817ad0d5cbd9053081e2d6acf16b11b"
server_key_version: "encryptionkey@0"
I20260812 00:27:08.701022 30487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "754e1df8f43542239ecec077171c2215"
format_stamp: "Formatted at 2026-08-12 00:27:08 on dist-test-slave-c12x"
server_key: "b6f115ec925884f74878c7f4f178b89b"
server_key_iv: "b817ad0d5cbd9053081e2d6acf16b11b"
server_key_version: "encryptionkey@0"
I20260812 00:27:08.706759 30487 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 00:27:08.710917 30506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:08.712445 30487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260812 00:27:08.712641 30487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "754e1df8f43542239ecec077171c2215"
format_stamp: "Formatted at 2026-08-12 00:27:08 on dist-test-slave-c12x"
server_key: "b6f115ec925884f74878c7f4f178b89b"
server_key_iv: "b817ad0d5cbd9053081e2d6acf16b11b"
server_key_version: "encryptionkey@0"
I20260812 00:27:08.712858 30487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:08.728317 30487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:08.733566 30487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:08.733862 30487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:08.756150 30487 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:44929
I20260812 00:27:08.756291 30583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:44929 every 8 connection(s)
I20260812 00:27:08.757850 30487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:08.762122 30585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:08.767225 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30487
I20260812 00:27:08.767659 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:08.769811 30458 external_mini_cluster.cc:1428] Setting key 9cdb3fc6b872aedd6252eddedb5292b1
I20260812 00:27:08.772994 30585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215: Bootstrap starting.
I20260812 00:27:08.777532 30585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:08.778971 30585 log.cc:824] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:08.782734 30585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215: No bootstrap required, opened a new log
I20260812 00:27:08.795248 30585 raft_consensus.cc:348] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "754e1df8f43542239ecec077171c2215" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44929 } }
I20260812 00:27:08.795779 30585 raft_consensus.cc:374] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:08.795928 30585 raft_consensus.cc:729] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 754e1df8f43542239ecec077171c2215, State: Initialized, Role: FOLLOWER
I20260812 00:27:08.796659 30585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "754e1df8f43542239ecec077171c2215" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44929 } }
I20260812 00:27:08.796937 30585 raft_consensus.cc:388] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:08.797115 30585 raft_consensus.cc:482] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:08.797319 30585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:08.799849 30585 raft_consensus.cc:504] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "754e1df8f43542239ecec077171c2215" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44929 } }
I20260812 00:27:08.800419 30585 leader_election.cc:302] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 754e1df8f43542239ecec077171c2215; no voters:
I20260812 00:27:08.801170 30585 leader_election.cc:288] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:08.801330 30591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:08.803372 30585 sys_catalog.cc:564] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:08.805166 30591 raft_consensus.cc:686] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [term 1 LEADER]: Becoming Leader. State: Replica: 754e1df8f43542239ecec077171c2215, State: Running, Role: LEADER
Aug 12 00:27:08 dist-test-slave-c12x krb5kdc[30469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:08.805862 30591 consensus_queue.cc:237] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "754e1df8f43542239ecec077171c2215" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44929 } }
I20260812 00:27:08.810185 30594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 754e1df8f43542239ecec077171c2215. Latest consensus state: current_term: 1 leader_uuid: "754e1df8f43542239ecec077171c2215" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "754e1df8f43542239ecec077171c2215" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44929 } } }
I20260812 00:27:08.811570 30594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:08.810825 30592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "754e1df8f43542239ecec077171c2215" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "754e1df8f43542239ecec077171c2215" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44929 } } }
I20260812 00:27:08.812117 30592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:08.817216 30608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:08.822486 30588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:08.774256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36480 (local address 127.29.190.190:44929)
0812 00:27:08.775489 (+ 1233us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:08.775510 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:08.776836 (+ 1326us) server_negotiation.cc:407] Connection header received
0812 00:27:08.789381 (+ 12545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:08.789406 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:08.789877 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:08.790236 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:08.794466 (+ 4230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:08.796157 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:08.798204 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:08.798941 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:08.799178 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:08.808725 (+ 9547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:08.808748 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:08.808774 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:08.808841 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:08.815582 (+ 6741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:08.816862 (+ 1280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:08.816874 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:08.816885 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:08.817768 (+ 883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:08.818405 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:08.818408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:08.818411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:08.819038 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:08.819550 (+ 512us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:08.820594 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0812 00:27:08.821072 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":531,"threads_started":1}
I20260812 00:27:08.823189 30608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:08.832535 30608 catalog_manager.cc:1347] Generated new cluster ID: 2a887fd05b474ca6bcec126213f8f3fa
I20260812 00:27:08.832685 30608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:08.852516 30608 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:08.854640 30608 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:08.884367 30608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 754e1df8f43542239ecec077171c2215: Generated new TSK 0
I20260812 00:27:08.885638 30608 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:27:08.940793 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:44929
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:09.301163 30622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:09.301553 30622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:09.301748 30622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:09.310802 30622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:09.310969 30622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:09.311173 30622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:09.322134 30622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:44929
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:09.323612 30622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:09.325040 30622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:09.339381 30632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:09.339636 30631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:09.339735 30636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:09.340819 30622 server_base.cc:1034] running on GCE node
I20260812 00:27:09.341544 30622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:09.342634 30622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:09.343871 30622 hybrid_clock.cc:648] HybridClock initialized: now 1786494429343791 us; error 76 us; skew 500 ppm
I20260812 00:27:09.344215 30622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:09 dist-test-slave-c12x krb5kdc[30469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494429, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:09.347752 30622 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:27:09.349421 30622 webserver.cc:460] Webserver started at http://127.29.190.129:39409/ using document root <none> and password file <none>
I20260812 00:27:09.350168 30622 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:09.350324 30622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:09.350680 30622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:09.353981 30622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "3296e9b205704eb2a53d25d4e9ae38d7"
format_stamp: "Formatted at 2026-08-12 00:27:09 on dist-test-slave-c12x"
server_key: "19ee5a1e4588946834d24cdc9e66f79c"
server_key_iv: "c1c44b622a9b82e8cdcb00224e57168d"
server_key_version: "encryptionkey@0"
I20260812 00:27:09.354887 30622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "3296e9b205704eb2a53d25d4e9ae38d7"
format_stamp: "Formatted at 2026-08-12 00:27:09 on dist-test-slave-c12x"
server_key: "19ee5a1e4588946834d24cdc9e66f79c"
server_key_iv: "c1c44b622a9b82e8cdcb00224e57168d"
server_key_version: "encryptionkey@0"
I20260812 00:27:09.360617 30622 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260812 00:27:09.364784 30648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:09.366377 30622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260812 00:27:09.366642 30622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "3296e9b205704eb2a53d25d4e9ae38d7"
format_stamp: "Formatted at 2026-08-12 00:27:09 on dist-test-slave-c12x"
server_key: "19ee5a1e4588946834d24cdc9e66f79c"
server_key_iv: "c1c44b622a9b82e8cdcb00224e57168d"
server_key_version: "encryptionkey@0"
I20260812 00:27:09.366884 30622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:09.413604 30622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:09.418812 30622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:09.419193 30622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:09.420675 30622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:09.422154 30622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:09.422232 30622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:09.422375 30622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:09.422453 30622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:09.463055 30622 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:37437
I20260812 00:27:09.463158 30809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:37437 every 8 connection(s)
I20260812 00:27:09.464493 30622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:09.473959 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30622
I20260812 00:27:09.474258 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:09.474958 30458 external_mini_cluster.cc:1428] Setting key 33c470346fa2be421ef866f6b44cddb6
Aug 12 00:27:09 dist-test-slave-c12x krb5kdc[30469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494429, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:09.488343 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:09.467290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:53907 (local address 127.29.190.190:44929)
0812 00:27:09.467842 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:09.467847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:09.469179 (+ 1332us) server_negotiation.cc:407] Connection header received
0812 00:27:09.471668 (+ 2489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:09.471674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:09.471804 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:09.471955 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:09.474024 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:09.475037 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:09.477035 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:09.477492 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:09.477639 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:09.481579 (+ 3940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:09.481585 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:09.481588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:09.481619 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:09.484516 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:09.485723 (+ 1207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:09.485729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:09.485731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:09.485863 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:09.486359 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:09.486364 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:09.486366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:09.486656 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:09.486825 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:09.487640 (+ 815us) server_negotiation.cc:299] Negotiation successful
0812 00:27:09.487887 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":294,"threads_started":1}
I20260812 00:27:09.489337 30815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:09.468002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:44929 (local address 127.29.190.129:53907)
0812 00:27:09.468957 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:09.469011 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:09.471299 (+ 2288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:09.472225 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:09.472234 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:09.472893 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:09.473779 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:09.473815 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:09.475246 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:09.475253 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:09.476845 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:09.476861 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:09.477771 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:09.477780 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:09.478073 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:09.478934 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:09.478959 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:09.481336 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:09.484705 (+ 3369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:09.484715 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:09.484741 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:09.485551 (+ 810us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:09.485991 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:09.485996 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:09.486000 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:09.486218 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:09.486805 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:09.486815 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:09.487198 (+ 383us) client_negotiation.cc:769] Sending connection context
0812 00:27:09.487530 (+ 332us) client_negotiation.cc:240] Negotiation successful
0812 00:27:09.488119 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":461,"threads_started":1}
I20260812 00:27:09.491063 30811 heartbeater.cc:347] Connected to a master server at 127.29.190.190:44929
I20260812 00:27:09.491396 30811 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:09.492205 30811 heartbeater.cc:511] Master 127.29.190.190:44929 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
I20260812 00:27:09.494477 30536 ts_manager.cc:194] Registered new tserver with Master: 3296e9b205704eb2a53d25d4e9ae38d7 (127.29.190.129:37437)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
I20260812 00:27:09.496331 30536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:53907
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:27:09.523020 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:44929
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:09.876576 30818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:09.876881 30818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:09.876991 30818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:09.884694 30818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:09.884871 30818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:09.885061 30818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:09.897804 30818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:44929
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:09.901317 30818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:09.903220 30818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:09.917811 30824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:09.917747 30830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:09.917779 30825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:09.921020 30818 server_base.cc:1034] running on GCE node
I20260812 00:27:09.921700 30818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:09.922843 30818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:09.924120 30818 hybrid_clock.cc:648] HybridClock initialized: now 1786494429924054 us; error 59 us; skew 500 ppm
I20260812 00:27:09.924486 30818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:09 dist-test-slave-c12x krb5kdc[30469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494429, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:09.927966 30818 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:27:09.929734 30818 webserver.cc:460] Webserver started at http://127.29.190.130:38445/ using document root <none> and password file <none>
I20260812 00:27:09.930522 30818 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:09.930680 30818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:09.931030 30818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:09.934217 30818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "da074c32deb2482dbada6cd4c3fa8ec4"
format_stamp: "Formatted at 2026-08-12 00:27:09 on dist-test-slave-c12x"
server_key: "12d07a6867102cfeee1b4b45db6c34a7"
server_key_iv: "54a4f96291e13bf372478b1cc30975b0"
server_key_version: "encryptionkey@0"
I20260812 00:27:09.935056 30818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "da074c32deb2482dbada6cd4c3fa8ec4"
format_stamp: "Formatted at 2026-08-12 00:27:09 on dist-test-slave-c12x"
server_key: "12d07a6867102cfeee1b4b45db6c34a7"
server_key_iv: "54a4f96291e13bf372478b1cc30975b0"
server_key_version: "encryptionkey@0"
I20260812 00:27:09.940765 30818 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:27:09.944700 30840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:09.946110 30818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:27:09.946309 30818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "da074c32deb2482dbada6cd4c3fa8ec4"
format_stamp: "Formatted at 2026-08-12 00:27:09 on dist-test-slave-c12x"
server_key: "12d07a6867102cfeee1b4b45db6c34a7"
server_key_iv: "54a4f96291e13bf372478b1cc30975b0"
server_key_version: "encryptionkey@0"
I20260812 00:27:09.946529 30818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:09.967185 30818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:09.971951 30818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:09.972278 30818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:09.973309 30818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:09.974781 30818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:09.974897 30818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:09.975065 30818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:09.975147 30818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:10.012221 30818 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:33925
I20260812 00:27:10.012274 30998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:33925 every 8 connection(s)
I20260812 00:27:10.013592 30818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:10.013998 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30818
I20260812 00:27:10.014219 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:10.014847 30458 external_mini_cluster.cc:1428] Setting key 38fa50424d3a06d4c431616ff1461e8d
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494429, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
I20260812 00:27:10.037352 31004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.016485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:60665 (local address 127.29.190.190:44929)
0812 00:27:10.017046 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:10.017051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:10.018341 (+ 1290us) server_negotiation.cc:407] Connection header received
0812 00:27:10.021429 (+ 3088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:10.021437 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:10.021526 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:10.021645 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:10.023846 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.024628 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.026236 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.026701 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.026842 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.030988 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:10.030994 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:10.030998 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:10.031031 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:10.033919 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.034824 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.034829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.034831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.034965 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.035469 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.035478 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.035481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.035776 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:10.035951 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:10.036706 (+ 755us) server_negotiation.cc:299] Negotiation successful
0812 00:27:10.036943 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":275,"threads_started":1}
I20260812 00:27:10.038374 31005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.017224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:44929 (local address 127.29.190.130:60665)
0812 00:27:10.018158 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:10.018226 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:10.021080 (+ 2854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:10.021927 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:10.021942 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:10.022789 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:10.023659 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:10.023680 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.024788 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.024794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:10.026077 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:10.026090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.026957 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.026965 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:10.027204 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.028015 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:10.028043 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:10.030739 (+ 2696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:10.034105 (+ 3366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:10.034115 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:10.034136 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:10.034672 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:10.035095 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:10.035101 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:10.035105 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:10.035317 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:10.035922 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:10.035931 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:10.036321 (+ 390us) client_negotiation.cc:769] Sending connection context
0812 00:27:10.036618 (+ 297us) client_negotiation.cc:240] Negotiation successful
0812 00:27:10.037186 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":331,"threads_started":1}
I20260812 00:27:10.040046 30999 heartbeater.cc:347] Connected to a master server at 127.29.190.190:44929
I20260812 00:27:10.040403 30999 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:10.041363 30999 heartbeater.cc:511] Master 127.29.190.190:44929 requested a full tablet report, sending...
I20260812 00:27:10.043165 30536 ts_manager.cc:194] Registered new tserver with Master: da074c32deb2482dbada6cd4c3fa8ec4 (127.29.190.130:33925)
I20260812 00:27:10.044065 30536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:60665
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:27:10.060113 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:44929
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:44761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:10.407641 31008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:10.407989 31008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:10.408176 31008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:10.415668 31008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:10.415830 31008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:10.416013 31008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:10.426178 31008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:44761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:44929
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:10.427661 31008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:10.429059 31008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:10.442678 31016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:10.442759 31017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:10.442951 31019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:10.444126 31008 server_base.cc:1034] running on GCE node
I20260812 00:27:10.444761 31008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:10.445770 31008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:10.447026 31008 hybrid_clock.cc:648] HybridClock initialized: now 1786494430446957 us; error 57 us; skew 500 ppm
I20260812 00:27:10.447486 31008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494430, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:10.451921 31008 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:27:10.453608 31008 webserver.cc:460] Webserver started at http://127.29.190.131:40933/ using document root <none> and password file <none>
I20260812 00:27:10.454348 31008 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:10.454456 31008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:10.454800 31008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:10.457939 31008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "b4c4fc60f88e49bb929b1c1ffb35f166"
format_stamp: "Formatted at 2026-08-12 00:27:10 on dist-test-slave-c12x"
server_key: "b7a4b78b5fdeddabe11c3e7eba2b7a64"
server_key_iv: "366b51f6b1c6d25a35945677c8280ce1"
server_key_version: "encryptionkey@0"
I20260812 00:27:10.458894 31008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "b4c4fc60f88e49bb929b1c1ffb35f166"
format_stamp: "Formatted at 2026-08-12 00:27:10 on dist-test-slave-c12x"
server_key: "b7a4b78b5fdeddabe11c3e7eba2b7a64"
server_key_iv: "366b51f6b1c6d25a35945677c8280ce1"
server_key_version: "encryptionkey@0"
I20260812 00:27:10.464977 31008 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:27:10.469516 31030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:10.470863 31008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:27:10.471037 31008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "b4c4fc60f88e49bb929b1c1ffb35f166"
format_stamp: "Formatted at 2026-08-12 00:27:10 on dist-test-slave-c12x"
server_key: "b7a4b78b5fdeddabe11c3e7eba2b7a64"
server_key_iv: "366b51f6b1c6d25a35945677c8280ce1"
server_key_version: "encryptionkey@0"
I20260812 00:27:10.471246 31008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:10.499671 30811 heartbeater.cc:503] Master 127.29.190.190:44929 was elected leader, sending a full tablet report...
I20260812 00:27:10.501495 31008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:10.506708 31008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:10.507026 31008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:10.508306 31008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:10.509799 31008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:10.509910 31008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:10.510071 31008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:10.510159 31008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:10.546419 31008 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:33421
I20260812 00:27:10.546514 31194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:33421 every 8 connection(s)
I20260812 00:27:10.547886 31008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:10.551285 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31008
I20260812 00:27:10.551537 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:10.551995 30458 external_mini_cluster.cc:1428] Setting key 9d8e9da175f4f781cb3614549001504e
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494430, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:10.569690 31197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.550752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:42019 (local address 127.29.190.190:44929)
0812 00:27:10.551400 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:10.551409 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:10.552656 (+ 1247us) server_negotiation.cc:407] Connection header received
0812 00:27:10.554644 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:10.554651 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:10.554753 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:10.554898 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:10.556594 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.557415 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.559221 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.559737 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.559898 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.563736 (+ 3838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:10.563742 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:10.563746 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:10.563782 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:10.566369 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.567142 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.567152 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.567155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.567281 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.567803 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.567807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.567809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.568102 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:10.568269 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:10.569024 (+ 755us) server_negotiation.cc:299] Negotiation successful
0812 00:27:10.569271 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":298,"threads_started":1}
I20260812 00:27:10.570639 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.551526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:44929 (local address 127.29.190.131:42019)
0812 00:27:10.552465 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:10.552513 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:10.554344 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:10.555154 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:10.555163 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:10.555797 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:10.556403 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:10.556423 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.557584 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.557596 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:10.559048 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:10.559063 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.559988 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.559997 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:10.560280 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.561049 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:10.561074 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:10.563411 (+ 2337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:10.566560 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:10.566569 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:10.566586 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:10.567006 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:10.567407 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:10.567412 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:10.567416 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:10.567666 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:10.568242 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:10.568251 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:10.568648 (+ 397us) client_negotiation.cc:769] Sending connection context
0812 00:27:10.568927 (+ 279us) client_negotiation.cc:240] Negotiation successful
0812 00:27:10.569499 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":396,"threads_started":1}
I20260812 00:27:10.572263 31195 heartbeater.cc:347] Connected to a master server at 127.29.190.190:44929
I20260812 00:27:10.572592 31195 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:10.573319 31195 heartbeater.cc:511] Master 127.29.190.190:44929 requested a full tablet report, sending...
I20260812 00:27:10.574818 30536 ts_manager.cc:194] Registered new tserver with Master: b4c4fc60f88e49bb929b1c1ffb35f166 (127.29.190.131:33421)
I20260812 00:27:10.575817 30536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:42019
I20260812 00:27:10.580504 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:10.629284 31206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.613257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59554 (local address 127.29.190.129:37437)
0812 00:27:10.613963 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:10.613970 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:10.614006 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:27:10.614124 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:10.614131 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:10.614341 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:10.614477 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:10.616045 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.617122 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.618420 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.618969 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.619077 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.623042 (+ 3965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:10.623055 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:10.623070 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:10.623112 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:10.625999 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.626743 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.626751 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.626753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.626946 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.627401 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.627405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.627407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.627965 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:10.628270 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:10.628586 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 00:27:10.628816 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":367,"threads_started":1}
W20260812 00:27:10.630695 30687 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59554
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:10.681069 31206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.666610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59570 (local address 127.29.190.129:37437)
0812 00:27:10.666892 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:10.666900 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:10.667108 (+ 208us) server_negotiation.cc:407] Connection header received
0812 00:27:10.667272 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:10.667276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:10.667363 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:10.667546 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:10.669092 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.669862 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.671228 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.671744 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.671854 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.676214 (+ 4360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:10.676220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:10.676223 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:10.676262 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:10.678735 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.679338 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.679342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.679344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.679528 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.679855 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.679858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.679860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.680115 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:10.680281 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:10.680551 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 00:27:10.680719 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260812 00:27:10.682618 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30622
I20260812 00:27:10.696372 31206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.683861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59578 (local address 127.29.190.129:37437)
0812 00:27:10.684091 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:10.684097 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:10.684245 (+ 148us) server_negotiation.cc:407] Connection header received
0812 00:27:10.684365 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:10.684369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:10.684428 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:10.684506 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:10.685766 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.686544 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.687924 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.688373 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.688491 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.690844 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:10.690849 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:10.690853 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:10.690886 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:10.693539 (+ 2653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.694271 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.694275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.694278 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.694427 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.694863 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.694867 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.694869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.695172 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:10.695366 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:10.695784 (+ 418us) server_negotiation.cc:299] Negotiation successful
0812 00:27:10.695960 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:27:10.697196 30801 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:10.783202 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30622
I20260812 00:27:10.805289 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30818
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:27:10.823813 31215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.806257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35348 (local address 127.29.190.130:33925)
0812 00:27:10.806881 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:10.806889 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:10.806916 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:27:10.806982 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:10.806988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:10.807198 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:10.807409 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:10.808820 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.809957 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.811230 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.811869 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.811992 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.816930 (+ 4938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:10.816943 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:10.816959 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:10.816997 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:10.820784 (+ 3787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.821552 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.821560 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.821562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.821705 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.822137 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.822140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.822143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.822552 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:10.822824 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:10.823172 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 00:27:10.823386 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":340,"threads_started":1}
I20260812 00:27:10.825215 30992 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:10.910739 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30818
I20260812 00:27:10.934592 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31008
Aug 12 00:27:10 dist-test-slave-c12x krb5kdc[30469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:27:10.952517 31218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:10.935795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41662 (local address 127.29.190.131:33421)
0812 00:27:10.936512 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:10.936519 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:10.936551 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:27:10.936617 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:10.936624 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:10.936844 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:10.936989 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:10.938308 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.939522 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.940847 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:10.941448 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:10.941558 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:10.946351 (+ 4793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:10.946370 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:10.946391 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:10.946437 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:10.949746 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.950441 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.950449 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.950451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.950606 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:10.950952 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:10.950955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:10.950957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:10.951302 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:10.951659 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:10.951892 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 00:27:10.952105 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":373,"threads_started":1}
I20260812 00:27:10.953938 31190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:11.040027 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31008
I20260812 00:27:11.068243 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30487
I20260812 00:27:11.069700 30579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:11.175890 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30487
2026-08-12T00:27:11Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4431 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:11 dist-test-slave-c12x krb5kdc[31223](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:11 dist-test-slave-c12x krb5kdc[31223](info): set up 2 sockets
Aug 12 00:27:11 dist-test-slave-c12x krb5kdc[31223](info): commencing operation
krb5kdc: starting...
W20260812 00:27:12.490048 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.002s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:12 dist-test-slave-c12x krb5kdc[31223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:12.695256 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:40965
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:40965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:13.039597 31246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:13.039928 31246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:13.040082 31246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:13.047694 31246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:13.047811 31246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:13.047920 31246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:13.048034 31246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:13.048115 31246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:13.058588 31246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:40965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:40965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:13.060036 31246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:13.061447 31246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:13.073978 31253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:13.073923 31257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:13.073916 31254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:13.074810 31246 server_base.cc:1034] running on GCE node
I20260812 00:27:13.075758 31246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:13.077400 31246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:13.078665 31246 hybrid_clock.cc:648] HybridClock initialized: now 1786494433078587 us; error 59 us; skew 500 ppm
I20260812 00:27:13.079138 31246 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:13 dist-test-slave-c12x krb5kdc[31223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494433, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:13.082463 31246 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:13.084146 31246 webserver.cc:460] Webserver started at http://127.29.190.190:41511/ using document root <none> and password file <none>
I20260812 00:27:13.084887 31246 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:13.085036 31246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:13.085366 31246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:13.088501 31246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "4f1089ab2d7a4f21a2de3375483beb88"
format_stamp: "Formatted at 2026-08-12 00:27:13 on dist-test-slave-c12x"
server_key: "4528d25ed0760ff16600c0375ba9af58"
server_key_iv: "692884fd3a08ad3d67ce6a2ec78bd05a"
server_key_version: "encryptionkey@0"
I20260812 00:27:13.089313 31246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "4f1089ab2d7a4f21a2de3375483beb88"
format_stamp: "Formatted at 2026-08-12 00:27:13 on dist-test-slave-c12x"
server_key: "4528d25ed0760ff16600c0375ba9af58"
server_key_iv: "692884fd3a08ad3d67ce6a2ec78bd05a"
server_key_version: "encryptionkey@0"
I20260812 00:27:13.094822 31246 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:27:13.098546 31272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:13.100112 31246 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:27:13.100332 31246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "4f1089ab2d7a4f21a2de3375483beb88"
format_stamp: "Formatted at 2026-08-12 00:27:13 on dist-test-slave-c12x"
server_key: "4528d25ed0760ff16600c0375ba9af58"
server_key_iv: "692884fd3a08ad3d67ce6a2ec78bd05a"
server_key_version: "encryptionkey@0"
I20260812 00:27:13.100665 31246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:13.130465 31246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:13.135749 31246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:13.136094 31246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:13.156857 31246 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:40965
I20260812 00:27:13.156876 31351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:40965 every 8 connection(s)
I20260812 00:27:13.158368 31246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:13.162515 31353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:13.166095 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31246
I20260812 00:27:13.166354 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:13.167033 30458 external_mini_cluster.cc:1428] Setting key 6f02f874fa5c25db4c2aea1d71838572
I20260812 00:27:13.176191 31353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88: Bootstrap starting.
I20260812 00:27:13.180521 31353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:13.182054 31353 log.cc:824] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:27:13 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:13.186093 31353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88: No bootstrap required, opened a new log
I20260812 00:27:13.192929 31358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:13.169136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42168 (local address 127.29.190.190:40965)
0812 00:27:13.169952 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:13.169964 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:13.170006 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:27:13.171739 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:13.171764 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:13.172167 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:13.172502 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:13.174502 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:13.176067 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:13.177868 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:13.178624 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:13.178766 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:13.184641 (+ 5875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:13.184650 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:13.184667 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:13.184707 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:13.188187 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:13.189193 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:13.189201 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:13.189208 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:13.189398 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:13.189857 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:13.189860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:13.189862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:13.190428 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:13.190697 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:13.191264 (+ 567us) server_negotiation.cc:299] Negotiation successful
0812 00:27:13.191822 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":398,"threads_started":1}
I20260812 00:27:13.196224 31353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f1089ab2d7a4f21a2de3375483beb88" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40965 } }
I20260812 00:27:13.196645 31353 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:13.196759 31353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1089ab2d7a4f21a2de3375483beb88, State: Initialized, Role: FOLLOWER
I20260812 00:27:13.197412 31353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f1089ab2d7a4f21a2de3375483beb88" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40965 } }
I20260812 00:27:13.197687 31353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:13.197841 31353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:13.198038 31353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:13.200492 31353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f1089ab2d7a4f21a2de3375483beb88" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40965 } }
I20260812 00:27:13.201038 31353 leader_election.cc:302] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f1089ab2d7a4f21a2de3375483beb88; no voters:
I20260812 00:27:13.201689 31353 leader_election.cc:288] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:13.201965 31360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:13.203507 31360 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1089ab2d7a4f21a2de3375483beb88, State: Running, Role: LEADER
I20260812 00:27:13.204173 31353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:13.204082 31360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f1089ab2d7a4f21a2de3375483beb88" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40965 } }
I20260812 00:27:13.207152 31362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f1089ab2d7a4f21a2de3375483beb88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f1089ab2d7a4f21a2de3375483beb88" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40965 } } }
I20260812 00:27:13.207631 31362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:13.208164 31363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f1089ab2d7a4f21a2de3375483beb88. Latest consensus state: current_term: 1 leader_uuid: "4f1089ab2d7a4f21a2de3375483beb88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f1089ab2d7a4f21a2de3375483beb88" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40965 } } }
I20260812 00:27:13.208580 31363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:13.211103 31368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:13.216897 31368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:13.226881 31368 catalog_manager.cc:1347] Generated new cluster ID: d97e2b0298ca4cdd9e8900fed979947f
I20260812 00:27:13.227080 31368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:13.244860 31368 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:13.246340 31368 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:13.253787 31368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f1089ab2d7a4f21a2de3375483beb88: Generated new TSK 0
I20260812 00:27:13.254979 31368 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:27:13.308080 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:40965
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:13.657912 31393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:13.658239 31393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:13.658571 31393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:13.667061 31393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:13.667204 31393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:13.667455 31393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:13.678488 31393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:40965
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:13.680029 31393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:13.681488 31393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:13.695703 31399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:13.695670 31403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:13.695650 31401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:13.696774 31393 server_base.cc:1034] running on GCE node
I20260812 00:27:13.697391 31393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:13.698412 31393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:13.699663 31393 hybrid_clock.cc:648] HybridClock initialized: now 1786494433699610 us; error 40 us; skew 500 ppm
I20260812 00:27:13.699998 31393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:13 dist-test-slave-c12x krb5kdc[31223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494433, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:13.703291 31393 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:27:13.705149 31393 webserver.cc:460] Webserver started at http://127.29.190.129:44273/ using document root <none> and password file <none>
I20260812 00:27:13.705921 31393 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:13.706097 31393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:13.706454 31393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:13.709663 31393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "e584e9e9bc3641559c272f5c67594621"
format_stamp: "Formatted at 2026-08-12 00:27:13 on dist-test-slave-c12x"
server_key: "1f1cb799604bbd677d152bedbb1cde4f"
server_key_iv: "871452b80669ad8d1caba19392024fec"
server_key_version: "encryptionkey@0"
I20260812 00:27:13.710546 31393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "e584e9e9bc3641559c272f5c67594621"
format_stamp: "Formatted at 2026-08-12 00:27:13 on dist-test-slave-c12x"
server_key: "1f1cb799604bbd677d152bedbb1cde4f"
server_key_iv: "871452b80669ad8d1caba19392024fec"
server_key_version: "encryptionkey@0"
I20260812 00:27:13.716130 31393 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 00:27:13.719770 31413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:13.721210 31393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:27:13.721400 31393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "e584e9e9bc3641559c272f5c67594621"
format_stamp: "Formatted at 2026-08-12 00:27:13 on dist-test-slave-c12x"
server_key: "1f1cb799604bbd677d152bedbb1cde4f"
server_key_iv: "871452b80669ad8d1caba19392024fec"
server_key_version: "encryptionkey@0"
I20260812 00:27:13.721630 31393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:13.734952 31393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:13.739635 31393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:13.740038 31393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:13.741453 31393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:13.743515 31393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:13.743597 31393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 00:27:13.743705 31393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:13.743765 31393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:13.778564 31393 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:34541
I20260812 00:27:13.778644 31573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:34541 every 8 connection(s)
I20260812 00:27:13.780005 31393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:13.789563 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31393
I20260812 00:27:13.789814 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:13.790437 30458 external_mini_cluster.cc:1428] Setting key 35369db34a61974d573f01c79136f465
Aug 12 00:27:13 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494433, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:13.800591 31577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:13.782762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:47717 (local address 127.29.190.190:40965)
0812 00:27:13.783257 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:13.783262 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:13.784121 (+ 859us) server_negotiation.cc:407] Connection header received
0812 00:27:13.786023 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:13.786028 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:13.786129 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:13.786253 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:13.787918 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:13.788673 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:13.790395 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:13.790869 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:13.791012 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:13.794616 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:13.794621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:13.794625 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:13.794658 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:13.797314 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:13.798092 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:13.798104 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:13.798107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:13.798227 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:13.798684 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:13.798689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:13.798694 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:13.798965 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:13.799127 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:13.799949 (+ 822us) server_negotiation.cc:299] Negotiation successful
0812 00:27:13.800193 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":288,"threads_started":1}
I20260812 00:27:13.801609 31578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:13.783209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:40965 (local address 127.29.190.129:47717)
0812 00:27:13.783951 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:13.783990 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:13.785734 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:13.786508 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:13.786517 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:13.787077 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:13.787734 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:13.787754 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:13.788844 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:13.788848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:13.790246 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:13.790259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:13.791120 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:13.791129 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:13.791364 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:13.792135 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:13.792159 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:13.794360 (+ 2201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:13.797470 (+ 3110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:13.797481 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:13.797499 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:13.797951 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:13.798346 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:13.798351 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:13.798354 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:13.798556 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:13.799109 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:13.799117 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:13.799553 (+ 436us) client_negotiation.cc:769] Sending connection context
0812 00:27:13.799831 (+ 278us) client_negotiation.cc:240] Negotiation successful
0812 00:27:13.800416 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":310,"threads_started":1}
I20260812 00:27:13.803337 31575 heartbeater.cc:347] Connected to a master server at 127.29.190.190:40965
I20260812 00:27:13.803683 31575 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:13.804550 31575 heartbeater.cc:511] Master 127.29.190.190:40965 requested a full tablet report, sending...
I20260812 00:27:13.807286 31297 ts_manager.cc:194] Registered new tserver with Master: e584e9e9bc3641559c272f5c67594621 (127.29.190.129:34541)
I20260812 00:27:13.809651 31297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:47717
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:27:13.839083 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:40965
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:14.174767 31583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:14.175040 31583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:14.175246 31583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:14.182632 31583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:14.182737 31583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:14.182911 31583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:14.192935 31583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:40965
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:14.194257 31583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:14.195703 31583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:14.209431 31589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:14.209393 31598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:14.209466 31594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:14.210330 31583 server_base.cc:1034] running on GCE node
I20260812 00:27:14.211056 31583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:14.212118 31583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:14.213341 31583 hybrid_clock.cc:648] HybridClock initialized: now 1786494434213296 us; error 54 us; skew 500 ppm
I20260812 00:27:14.213665 31583 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:14 dist-test-slave-c12x krb5kdc[31223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494434, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:14.216862 31583 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:27:14.218247 31583 webserver.cc:460] Webserver started at http://127.29.190.130:43507/ using document root <none> and password file <none>
I20260812 00:27:14.218953 31583 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:14.219099 31583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:14.219421 31583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:14.222419 31583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "ce1413b6bd1440428d0cb1f077bbf9fb"
format_stamp: "Formatted at 2026-08-12 00:27:14 on dist-test-slave-c12x"
server_key: "f046eea43d875828cdae908611630dae"
server_key_iv: "7626111bdbb36293206f7803388df787"
server_key_version: "encryptionkey@0"
I20260812 00:27:14.223186 31583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "ce1413b6bd1440428d0cb1f077bbf9fb"
format_stamp: "Formatted at 2026-08-12 00:27:14 on dist-test-slave-c12x"
server_key: "f046eea43d875828cdae908611630dae"
server_key_iv: "7626111bdbb36293206f7803388df787"
server_key_version: "encryptionkey@0"
I20260812 00:27:14.228648 31583 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:27:14.232517 31607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:14.233920 31583 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:27:14.234103 31583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "ce1413b6bd1440428d0cb1f077bbf9fb"
format_stamp: "Formatted at 2026-08-12 00:27:14 on dist-test-slave-c12x"
server_key: "f046eea43d875828cdae908611630dae"
server_key_iv: "7626111bdbb36293206f7803388df787"
server_key_version: "encryptionkey@0"
I20260812 00:27:14.234309 31583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:14.248612 31583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:14.253159 31583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:14.253454 31583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:14.254426 31583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:14.255903 31583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:14.255976 31583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:14.256122 31583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:14.256201 31583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:14.292209 31583 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:44813
I20260812 00:27:14.292378 31766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:44813 every 8 connection(s)
I20260812 00:27:14.293651 31583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:14.299585 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31583
I20260812 00:27:14.299801 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:14.300377 30458 external_mini_cluster.cc:1428] Setting key da6cc48e17ad7202e784baac3b492784
Aug 12 00:27:14 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494434, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:14.318830 31577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.296468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:37759 (local address 127.29.190.190:40965)
0812 00:27:14.296691 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:14.296698 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:14.298007 (+ 1309us) server_negotiation.cc:407] Connection header received
0812 00:27:14.300036 (+ 2029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:14.300043 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:14.300142 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:14.300267 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:14.302210 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.303040 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.305813 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.306258 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.306358 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.310930 (+ 4572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:14.310940 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:14.310948 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:14.310999 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:14.314913 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:14.315874 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:14.315884 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:14.315890 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:14.316063 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:14.316523 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:14.316531 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:14.316537 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:14.316968 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:14.317141 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:14.318006 (+ 865us) server_negotiation.cc:299] Negotiation successful
0812 00:27:14.318315 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:27:14.319566 31771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.296990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:40965 (local address 127.29.190.130:37759)
0812 00:27:14.297807 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:14.297853 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:14.299659 (+ 1806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:14.300619 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:14.300628 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:14.301298 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:14.301982 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.302002 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.303219 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.303227 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.305654 (+ 2427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.305673 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.306500 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.306507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.306860 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.307799 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:14.307834 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:14.310653 (+ 2819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:14.315128 (+ 4475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:14.315136 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:14.315151 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:14.315715 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:14.316182 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:14.316185 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:14.316188 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:14.316382 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:14.317105 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:14.317111 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:14.317572 (+ 461us) client_negotiation.cc:769] Sending connection context
0812 00:27:14.317823 (+ 251us) client_negotiation.cc:240] Negotiation successful
0812 00:27:14.318267 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":329,"threads_started":1}
I20260812 00:27:14.321357 31768 heartbeater.cc:347] Connected to a master server at 127.29.190.190:40965
I20260812 00:27:14.321766 31768 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
I20260812 00:27:14.322685 31768 heartbeater.cc:511] Master 127.29.190.190:40965 requested a full tablet report, sending...
I20260812 00:27:14.324453 31297 ts_manager.cc:194] Registered new tserver with Master: ce1413b6bd1440428d0cb1f077bbf9fb (127.29.190.130:44813)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
I20260812 00:27:14.325697 31297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:37759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:27:14.350515 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:40965
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:14.703178 31779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:14.703552 31779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:14.703728 31779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:14.711547 31779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:14.711704 31779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:14.711922 31779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:14.722211 31779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:40965
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:14.723870 31779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:14.725481 31779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:14.739897 31787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:14.739857 31789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:14.740550 31784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:14.741550 31779 server_base.cc:1034] running on GCE node
I20260812 00:27:14.742381 31779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:14.743747 31779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:14.745021 31779 hybrid_clock.cc:648] HybridClock initialized: now 1786494434744931 us; error 73 us; skew 500 ppm
I20260812 00:27:14.745471 31779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:14 dist-test-slave-c12x krb5kdc[31223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494434, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:14.749909 31779 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:27:14.752777 31779 webserver.cc:460] Webserver started at http://127.29.190.131:36779/ using document root <none> and password file <none>
I20260812 00:27:14.753649 31779 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:14.753818 31779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:14.754179 31779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:14.757390 31779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "1b163319c3c441d5b6f3aea021c9a418"
format_stamp: "Formatted at 2026-08-12 00:27:14 on dist-test-slave-c12x"
server_key: "3c640259d97e4ecced87ef58449aa111"
server_key_iv: "c4350df452334ac1d420f0aff3df1aea"
server_key_version: "encryptionkey@0"
I20260812 00:27:14.758236 31779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "1b163319c3c441d5b6f3aea021c9a418"
format_stamp: "Formatted at 2026-08-12 00:27:14 on dist-test-slave-c12x"
server_key: "3c640259d97e4ecced87ef58449aa111"
server_key_iv: "c4350df452334ac1d420f0aff3df1aea"
server_key_version: "encryptionkey@0"
I20260812 00:27:14.764250 31779 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260812 00:27:14.772812 31805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:14.774592 31779 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.002s
I20260812 00:27:14.774791 31779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "1b163319c3c441d5b6f3aea021c9a418"
format_stamp: "Formatted at 2026-08-12 00:27:14 on dist-test-slave-c12x"
server_key: "3c640259d97e4ecced87ef58449aa111"
server_key_iv: "c4350df452334ac1d420f0aff3df1aea"
server_key_version: "encryptionkey@0"
I20260812 00:27:14.775068 31779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:14.802881 31779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:14.808173 31779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:14.808502 31779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:14.809648 31779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:14.811422 31779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:14.811561 31779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 00:27:14.811712 31779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:14.811784 31779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:14.813380 31575 heartbeater.cc:503] Master 127.29.190.190:40965 was elected leader, sending a full tablet report...
I20260812 00:27:14.856056 31779 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:33477
I20260812 00:27:14.856124 31966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:33477 every 8 connection(s)
I20260812 00:27:14.857399 31779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:14.863185 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31779
I20260812 00:27:14.863422 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:14.863965 30458 external_mini_cluster.cc:1428] Setting key 164e2873f35464e6c7adc5726eb08b3b
Aug 12 00:27:14 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494434, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:14.878716 31971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.859969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:34847 (local address 127.29.190.190:40965)
0812 00:27:14.860491 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:14.860496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:14.861290 (+ 794us) server_negotiation.cc:407] Connection header received
0812 00:27:14.863631 (+ 2341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:14.863636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:14.863709 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:14.863830 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:14.866016 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.866913 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.868557 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.868978 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.869151 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.872822 (+ 3671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:14.872827 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:14.872830 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:14.872863 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:14.875505 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:14.876233 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:14.876237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:14.876239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:14.876365 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:14.876769 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:14.876772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:14.876774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:14.877042 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:14.877163 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:14.877946 (+ 783us) server_negotiation.cc:299] Negotiation successful
0812 00:27:14.878195 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":309,"threads_started":1}
I20260812 00:27:14.879894 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.860380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:40965 (local address 127.29.190.131:34847)
0812 00:27:14.861115 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:14.861154 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:14.863117 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:14.864145 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:14.864157 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:14.864923 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:14.865796 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.865826 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.867083 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.867093 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.868402 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.868415 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.869265 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.869273 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.869498 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.870210 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:14.870234 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:14.872625 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:14.875662 (+ 3037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:14.875669 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:14.875683 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:14.876123 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:14.876462 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:14.876465 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:14.876467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:14.876671 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:14.877158 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:14.877164 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:14.877516 (+ 352us) client_negotiation.cc:769] Sending connection context
0812 00:27:14.877839 (+ 323us) client_negotiation.cc:240] Negotiation successful
0812 00:27:14.878397 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":288,"threads_started":1}
I20260812 00:27:14.881299 31967 heartbeater.cc:347] Connected to a master server at 127.29.190.190:40965
I20260812 00:27:14.881656 31967 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:14.882438 31967 heartbeater.cc:511] Master 127.29.190.190:40965 requested a full tablet report, sending...
I20260812 00:27:14.883976 31297 ts_manager.cc:194] Registered new tserver with Master: 1b163319c3c441d5b6f3aea021c9a418 (127.29.190.131:33477)
I20260812 00:27:14.884783 31297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:34847
I20260812 00:27:14.892612 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:27:14.916236 31971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.899174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42174 (local address 127.29.190.190:40965)
0812 00:27:14.899379 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:14.899383 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:14.900014 (+ 631us) server_negotiation.cc:407] Connection header received
0812 00:27:14.900121 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:14.900125 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:14.900228 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:14.900330 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:14.901981 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.902733 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.904250 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.904929 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.905075 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.908553 (+ 3478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:14.908562 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:14.908570 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:14.908625 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:14.912662 (+ 4037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:14.913568 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:14.913576 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:14.913582 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:14.913727 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:14.914282 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:14.914289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:14.914295 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:14.914754 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:14.914997 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:14.915547 (+ 550us) server_negotiation.cc:299] Negotiation successful
0812 00:27:14.915824 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:27:14.923764 31297 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:27:14.931627 31297 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:14.961030 31993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.950064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.29.190.130:44813)
0812 00:27:14.952465 (+ 2401us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:14.952474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:14.952501 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:27:14.952588 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:14.952598 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:14.952808 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:14.953002 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:14.953989 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.955534 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.958163 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.959804 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.959985 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.960173 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:14.960524 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 00:27:14.960692 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2242,"thread_start_us":2135,"threads_started":1}
I20260812 00:27:14.961474 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.947076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54588 (local address 127.29.190.129:34541)
0812 00:27:14.948196 (+ 1120us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:14.948209 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:14.950206 (+ 1997us) server_negotiation.cc:407] Connection header received
0812 00:27:14.950348 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:14.950362 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:14.950722 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:14.950966 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:14.953545 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.955245 (+ 1700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.958410 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.959826 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.960030 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.960173 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:14.960962 (+ 789us) server_negotiation.cc:299] Negotiation successful
0812 00:27:14.961142 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":653,"threads_started":1}
I20260812 00:27:14.961568 31989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.945951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:33477 (local address 127.0.0.1:52430)
0812 00:27:14.948899 (+ 2948us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:14.948948 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:14.949201 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:14.952551 (+ 3350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:14.952557 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:14.952586 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:14.953065 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.953078 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.955222 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.955230 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.958742 (+ 3512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.958754 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.960405 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.960411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.960614 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.960732 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 00:27:14.960830 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:27:14.960978 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2621,"mutex_wait_us":286,"thread_start_us":3488,"threads_started":1}
I20260812 00:27:14.961489 31995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.950778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:44813 (local address 127.0.0.1:47148)
0812 00:27:14.952173 (+ 1395us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:14.952191 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:14.952311 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:14.953282 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:14.953287 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:14.953311 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:14.953784 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.953799 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.955673 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.955679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.958000 (+ 2321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.958013 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.960041 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.960050 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.960252 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.960311 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 00:27:14.960466 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 00:27:14.960670 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1277,"mutex_wait_us":236,"thread_start_us":1105,"threads_started":1}
I20260812 00:27:14.961932 31986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.946160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52430 (local address 127.29.190.131:33477)
0812 00:27:14.951908 (+ 5748us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:14.951920 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:14.951959 (+ 39us) server_negotiation.cc:407] Connection header received
0812 00:27:14.952067 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:14.952075 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:14.952323 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:14.952565 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:14.953345 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.955032 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.958902 (+ 3870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.959968 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.960166 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.960337 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:14.961430 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0812 00:27:14.961631 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5542,"thread_start_us":5358,"threads_started":1}
I20260812 00:27:14.962507 31985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:14.946319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34541 (local address 127.0.0.1:54588)
0812 00:27:14.949819 (+ 3500us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:14.949845 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:14.950027 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:14.952489 (+ 2462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:14.952497 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:14.952531 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:14.953285 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.953297 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.955390 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.955396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.958236 (+ 2840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:14.958250 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:14.960353 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:14.960363 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:14.960610 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:14.960732 (+ 122us) client_negotiation.cc:769] Sending connection context
0812 00:27:14.960822 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 00:27:14.962227 (+ 1405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3316,"mutex_wait_us":1492,"thread_start_us":2072,"threads_started":1}
I20260812 00:27:14.965755 31870 tablet_service.cc:1467] Processing CreateTablet for tablet c07570fe375b40d999b76c0d6e253a40 (DEFAULT_TABLE table=test-table [id=94b45ce282d146969c32e43a0ce95c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:14.966250 31674 tablet_service.cc:1467] Processing CreateTablet for tablet c07570fe375b40d999b76c0d6e253a40 (DEFAULT_TABLE table=test-table [id=94b45ce282d146969c32e43a0ce95c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:14.966250 31475 tablet_service.cc:1467] Processing CreateTablet for tablet c07570fe375b40d999b76c0d6e253a40 (DEFAULT_TABLE table=test-table [id=94b45ce282d146969c32e43a0ce95c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:14.967166 31870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c07570fe375b40d999b76c0d6e253a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:14.967665 31475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c07570fe375b40d999b76c0d6e253a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:14.967665 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c07570fe375b40d999b76c0d6e253a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:14.978637 31996 tablet_bootstrap.cc:492] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418: Bootstrap starting.
I20260812 00:27:14.982009 31996 tablet_bootstrap.cc:654] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:14.982635 31998 tablet_bootstrap.cc:492] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb: Bootstrap starting.
I20260812 00:27:14.983613 31996 log.cc:824] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:14.986794 31998 tablet_bootstrap.cc:654] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:14.988410 31998 log.cc:824] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:14.989132 31999 tablet_bootstrap.cc:492] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621: Bootstrap starting.
I20260812 00:27:14.991694 31998 tablet_bootstrap.cc:492] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb: No bootstrap required, opened a new log
I20260812 00:27:14.991698 31996 tablet_bootstrap.cc:492] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418: No bootstrap required, opened a new log
I20260812 00:27:14.991991 31996 ts_tablet_manager.cc:1397] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260812 00:27:14.991994 31998 ts_tablet_manager.cc:1397] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 00:27:14.992846 31999 tablet_bootstrap.cc:654] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:14.994134 31999 log.cc:824] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:14.997135 31999 tablet_bootstrap.cc:492] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621: No bootstrap required, opened a new log
I20260812 00:27:14.997426 31999 ts_tablet_manager.cc:1397] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 00:27:15.003230 31998 raft_consensus.cc:348] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.003224 31996 raft_consensus.cc:348] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.003780 31998 raft_consensus.cc:374] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:15.003780 31996 raft_consensus.cc:374] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:15.003933 31996 raft_consensus.cc:729] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b163319c3c441d5b6f3aea021c9a418, State: Initialized, Role: FOLLOWER
I20260812 00:27:15.003892 31998 raft_consensus.cc:729] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1413b6bd1440428d0cb1f077bbf9fb, State: Initialized, Role: FOLLOWER
I20260812 00:27:15.004810 31996 consensus_queue.cc:260] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.005156 31998 consensus_queue.cc:260] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.005132 31999 raft_consensus.cc:348] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.005975 31999 raft_consensus.cc:374] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:15.006088 31999 raft_consensus.cc:729] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e584e9e9bc3641559c272f5c67594621, State: Initialized, Role: FOLLOWER
I20260812 00:27:15.006522 31967 heartbeater.cc:503] Master 127.29.190.190:40965 was elected leader, sending a full tablet report...
I20260812 00:27:15.007174 31996 ts_tablet_manager.cc:1428] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260812 00:27:15.007176 31768 heartbeater.cc:503] Master 127.29.190.190:40965 was elected leader, sending a full tablet report...
I20260812 00:27:15.007746 31998 ts_tablet_manager.cc:1428] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260812 00:27:15.008828 31999 consensus_queue.cc:260] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.010672 31999 ts_tablet_manager.cc:1428] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
W20260812 00:27:15.032735 31576 tablet.cc:2369] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:27:15.046104 31769 tablet.cc:2369] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:27:15.109293 31968 tablet.cc:2369] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:15.325701 32004 raft_consensus.cc:482] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:15.326116 32004 raft_consensus.cc:504] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.328051 32004 leader_election.cc:288] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce1413b6bd1440428d0cb1f077bbf9fb (127.29.190.130:44813), e584e9e9bc3641559c272f5c67594621 (127.29.190.129:34541)
I20260812 00:27:15.334976 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.328471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34541 (local address 127.29.190.131:40155)
0812 00:27:15.328654 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:15.328676 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:15.328821 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:15.329298 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:15.329305 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:15.329339 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:15.329595 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:15.329608 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.330965 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.330971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:15.332576 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:15.332591 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.334055 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.334062 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:15.334280 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.334318 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:27:15.334428 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 00:27:15.334582 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":1}
I20260812 00:27:15.335062 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.328738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:40155 (local address 127.29.190.129:34541)
0812 00:27:15.328973 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:15.328979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:15.329004 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:27:15.329070 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:15.329073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:15.329149 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:15.329260 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:15.329762 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.330804 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.332777 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.333871 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.334011 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.334071 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:15.334570 (+ 499us) server_negotiation.cc:299] Negotiation successful
0812 00:27:15.334760 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:27:15.335834 31993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.328498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:59163 (local address 127.29.190.130:44813)
0812 00:27:15.328718 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:15.328724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:15.329463 (+ 739us) server_negotiation.cc:407] Connection header received
0812 00:27:15.329629 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:15.329634 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:15.329730 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:15.329812 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:15.330457 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.331415 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.333512 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.334582 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.334780 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.334850 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:15.335400 (+ 550us) server_negotiation.cc:299] Negotiation successful
0812 00:27:15.335590 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:27:15.336683 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.328477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:44813 (local address 127.29.190.131:59163)
0812 00:27:15.329349 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:15.329365 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:15.329482 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:15.329872 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:15.329877 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:15.329905 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:15.330295 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:15.330310 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.331641 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.331649 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:15.333303 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:15.333319 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.334879 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.334887 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:15.335149 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.335195 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:27:15.336067 (+ 872us) client_negotiation.cc:240] Negotiation successful
0812 00:27:15.336229 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":204,"thread_start_us":386,"threads_started":1}
I20260812 00:27:15.336421 31505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c07570fe375b40d999b76c0d6e253a40" candidate_uuid: "1b163319c3c441d5b6f3aea021c9a418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e584e9e9bc3641559c272f5c67594621" is_pre_election: true
I20260812 00:27:15.337110 31505 raft_consensus.cc:2454] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b163319c3c441d5b6f3aea021c9a418 in term 0.
I20260812 00:27:15.337929 31806 leader_election.cc:302] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b163319c3c441d5b6f3aea021c9a418, e584e9e9bc3641559c272f5c67594621; no voters:
I20260812 00:27:15.337879 31702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c07570fe375b40d999b76c0d6e253a40" candidate_uuid: "1b163319c3c441d5b6f3aea021c9a418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" is_pre_election: true
I20260812 00:27:15.338402 32004 raft_consensus.cc:2781] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:15.338460 31702 raft_consensus.cc:2454] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b163319c3c441d5b6f3aea021c9a418 in term 0.
I20260812 00:27:15.338608 32004 raft_consensus.cc:482] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:15.338811 32004 raft_consensus.cc:3037] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:15.341434 32004 raft_consensus.cc:504] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.342218 32004 leader_election.cc:288] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [CANDIDATE]: Term 1 election: Requested vote from peers ce1413b6bd1440428d0cb1f077bbf9fb (127.29.190.130:44813), e584e9e9bc3641559c272f5c67594621 (127.29.190.129:34541)
I20260812 00:27:15.342670 31702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c07570fe375b40d999b76c0d6e253a40" candidate_uuid: "1b163319c3c441d5b6f3aea021c9a418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb"
I20260812 00:27:15.342756 31505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c07570fe375b40d999b76c0d6e253a40" candidate_uuid: "1b163319c3c441d5b6f3aea021c9a418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e584e9e9bc3641559c272f5c67594621"
I20260812 00:27:15.342916 31702 raft_consensus.cc:3037] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:15.342984 31505 raft_consensus.cc:3037] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:15.346668 31702 raft_consensus.cc:2454] T c07570fe375b40d999b76c0d6e253a40 P ce1413b6bd1440428d0cb1f077bbf9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b163319c3c441d5b6f3aea021c9a418 in term 1.
I20260812 00:27:15.346668 31505 raft_consensus.cc:2454] T c07570fe375b40d999b76c0d6e253a40 P e584e9e9bc3641559c272f5c67594621 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b163319c3c441d5b6f3aea021c9a418 in term 1.
I20260812 00:27:15.347259 31806 leader_election.cc:302] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1b163319c3c441d5b6f3aea021c9a418, ce1413b6bd1440428d0cb1f077bbf9fb, e584e9e9bc3641559c272f5c67594621; no voters:
I20260812 00:27:15.347713 32004 raft_consensus.cc:2781] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:15.348222 32004 raft_consensus.cc:686] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [term 1 LEADER]: Becoming Leader. State: Replica: 1b163319c3c441d5b6f3aea021c9a418, State: Running, Role: LEADER
I20260812 00:27:15.348723 32004 consensus_queue.cc:237] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } }
I20260812 00:27:15.353847 31296 catalog_manager.cc:5495] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b163319c3c441d5b6f3aea021c9a418 (127.29.190.131). New cstate: current_term: 1 leader_uuid: "1b163319c3c441d5b6f3aea021c9a418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b163319c3c441d5b6f3aea021c9a418" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce1413b6bd1440428d0cb1f077bbf9fb" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e584e9e9bc3641559c272f5c67594621" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34541 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:27:15 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:15.429155 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.413498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54590 (local address 127.29.190.129:34541)
0812 00:27:15.413698 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:15.413703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:15.414229 (+ 526us) server_negotiation.cc:407] Connection header received
0812 00:27:15.414443 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:15.414455 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:15.414523 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:15.414645 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:15.416247 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.417079 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.418343 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.418789 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.418922 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.423016 (+ 4094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:15.423033 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:15.423050 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:15.423090 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:15.426130 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.426968 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.426977 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.426979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.427144 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.427651 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.427655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.427657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.428092 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:15.428326 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:15.428619 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:27:15.428795 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 00:27:15 dist-test-slave-c12x krb5kdc[31223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494435, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:27:15 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494435, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:15.484805 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.467386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54594 (local address 127.29.190.129:34541)
0812 00:27:15.467708 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:15.467717 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:15.468252 (+ 535us) server_negotiation.cc:407] Connection header received
0812 00:27:15.468518 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:15.468527 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:15.468636 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:15.468762 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:15.470481 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.471368 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.473289 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.473902 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.473995 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.479334 (+ 5339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:15.479341 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:15.479346 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:15.479417 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:15.482509 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.483134 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.483139 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.483141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.483274 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.483694 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.483698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.483700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.483965 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:15.484157 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:15.484377 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 00:27:15.484554 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
Aug 12 00:27:15 dist-test-slave-c12x krb5kdc[31223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:27:15 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:15.538923 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.522739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54610 (local address 127.29.190.129:34541)
0812 00:27:15.522998 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:15.523013 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:15.523292 (+ 279us) server_negotiation.cc:407] Connection header received
0812 00:27:15.523502 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:15.523508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:15.523582 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:15.523677 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:15.525181 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.525887 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.527310 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.527801 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.527921 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.532424 (+ 4503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:15.532430 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:15.532434 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:15.532483 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:15.535343 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.536394 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.536404 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.536442 (+ 38us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.536629 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.537090 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.537098 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.537107 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.537452 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:15.537767 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:15.538135 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 00:27:15.538502 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260812 00:27:15.540885 31445 tablet_service.cc:2908] Rejecting scan request for tablet c07570fe375b40d999b76c0d6e253a40: Uninitialized: clean time has not yet been initialized
I20260812 00:27:15.544104 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31393
I20260812 00:27:15.558588 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.545128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54618 (local address 127.29.190.129:34541)
0812 00:27:15.545306 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:15.545310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:15.545709 (+ 399us) server_negotiation.cc:407] Connection header received
0812 00:27:15.545831 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:15.545835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:15.545912 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:15.546013 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:15.547263 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.548110 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.549354 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.549781 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.549907 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.552716 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:15.552722 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:15.552725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:15.552763 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:15.555911 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.556671 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.556676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.556678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.556802 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.557168 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.557172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.557175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.557550 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:15.557969 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:15.558134 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:27:15.558318 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:27:15.559525 31568 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:15.651964 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31393
I20260812 00:27:15.680560 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31583
Aug 12 00:27:15 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:27:15.697249 31993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.681423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47154 (local address 127.29.190.130:44813)
0812 00:27:15.681602 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:15.681606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:15.681691 (+ 85us) server_negotiation.cc:407] Connection header received
0812 00:27:15.681768 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:15.681772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:15.681840 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:15.681951 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:15.683182 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.684058 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.685368 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.685871 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.685997 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.690362 (+ 4365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:15.690381 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:15.690400 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:15.690482 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:15.693852 (+ 3370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.694701 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.694710 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.694713 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.694876 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.695318 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.695325 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.695335 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.695870 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:15.696244 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:15.696606 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 00:27:15.696866 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 00:27:15.698026 31761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:15.726544 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.726048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34541 (local address 127.29.190.131:34407)
0812 00:27:15.726238 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:15.726385 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260812 00:27:15.726859 31806 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34541: connect: Connection refused (error 111)
I20260812 00:27:15.728490 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.728089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34541 (local address 127.29.190.131:36761)
0812 00:27:15.728262 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:15.728352 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 00:27:15.728711 31806 consensus_peers.cc:487] T c07570fe375b40d999b76c0d6e253a40 P 1b163319c3c441d5b6f3aea021c9a418 -> Peer e584e9e9bc3641559c272f5c67594621 (127.29.190.129:34541): Couldn't send request to peer e584e9e9bc3641559c272f5c67594621. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:27:15.787853 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31583
I20260812 00:27:15.815224 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31779
Aug 12 00:27:15 dist-test-slave-c12x krb5kdc[31223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:27:15.833105 32032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:15.816223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52432 (local address 127.29.190.131:33477)
0812 00:27:15.816811 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:15.816816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:15.816840 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:27:15.816899 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:15.816903 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:15.816968 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:15.817095 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:15.818606 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.819355 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.821082 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:15.821563 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:15.821681 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:15.826234 (+ 4553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:15.826254 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:15.826273 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:15.826323 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:15.829944 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.830827 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.830837 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.830840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.831016 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:15.831425 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:15.831453 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:15.831457 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:15.831835 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:15.832168 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:15.832447 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 00:27:15.832695 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":347,"threads_started":1}
I20260812 00:27:15.833890 31960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:15.924321 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31779
I20260812 00:27:15.947245 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31246
I20260812 00:27:15.948653 31346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:16.063692 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31246
2026-08-12T00:27:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4890 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:16 dist-test-slave-c12x krb5kdc[32038](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:16 dist-test-slave-c12x krb5kdc[32038](info): set up 2 sockets
Aug 12 00:27:16 dist-test-slave-c12x krb5kdc[32038](info): commencing operation
krb5kdc: starting...
W20260812 00:27:17.400635 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.004s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:17 dist-test-slave-c12x krb5kdc[32038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:17.619583 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:34891
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:39353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:34891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:17.967518 32058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:17.967865 32058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:17.967970 32058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:17.975286 32058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:17.975394 32058 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:27:17.975489 32058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:17.975585 32058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:17.975641 32058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:17.975706 32058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:17.985968 32058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:34891
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:34891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:17.987322 32058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:17.988648 32058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:18.000610 32064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:18.000749 32065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:18.000783 32072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:18.001863 32058 server_base.cc:1034] running on GCE node
I20260812 00:27:18.002722 32058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:18.004254 32058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:18.005508 32058 hybrid_clock.cc:648] HybridClock initialized: now 1786494438005446 us; error 39 us; skew 500 ppm
I20260812 00:27:18.005848 32058 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:18 dist-test-slave-c12x krb5kdc[32038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494438, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:18.009122 32058 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:18.010720 32058 webserver.cc:460] Webserver started at http://127.29.190.190:34341/ using document root <none> and password file <none>
I20260812 00:27:18.011520 32058 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:18.011667 32058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:18.012012 32058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:18.015035 32058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "6f54db84e67b42c3a0f314cc6196b3fa"
format_stamp: "Formatted at 2026-08-12 00:27:18 on dist-test-slave-c12x"
server_key: "057fd8f2310f05e0694d8c81977bf5fd"
server_key_iv: "b4721717376177bc7b3cdca0f74e2ea6"
server_key_version: "encryptionkey@0"
I20260812 00:27:18.015877 32058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "6f54db84e67b42c3a0f314cc6196b3fa"
format_stamp: "Formatted at 2026-08-12 00:27:18 on dist-test-slave-c12x"
server_key: "057fd8f2310f05e0694d8c81977bf5fd"
server_key_iv: "b4721717376177bc7b3cdca0f74e2ea6"
server_key_version: "encryptionkey@0"
I20260812 00:27:18.021040 32058 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:27:18.024596 32080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:18.025889 32058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:27:18.026069 32058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "6f54db84e67b42c3a0f314cc6196b3fa"
format_stamp: "Formatted at 2026-08-12 00:27:18 on dist-test-slave-c12x"
server_key: "057fd8f2310f05e0694d8c81977bf5fd"
server_key_iv: "b4721717376177bc7b3cdca0f74e2ea6"
server_key_version: "encryptionkey@0"
I20260812 00:27:18.026304 32058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:18.040192 32058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:18.044443 32058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:18.044754 32058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:18.067740 32058 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:34891
I20260812 00:27:18.067761 32171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:34891 every 8 connection(s)
I20260812 00:27:18.069140 32058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:18.071686 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32058
I20260812 00:27:18.071935 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:18.072736 30458 external_mini_cluster.cc:1428] Setting key 2f55f2d81b252fca4367a6abbd51dfd7
I20260812 00:27:18.073796 32172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 00:27:18 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:18.089426 32172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa: Bootstrap starting.
I20260812 00:27:18.093045 32172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:18.094148 32172 log.cc:824] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:18.097271 32172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa: No bootstrap required, opened a new log
I20260812 00:27:18.097357 32176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:18.074910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49514 (local address 127.29.190.190:34891)
0812 00:27:18.075749 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:18.075761 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:18.075802 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:27:18.077395 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:18.077418 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:18.077827 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:18.078170 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:18.080134 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.081501 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.083240 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.083989 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.084125 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:18.089536 (+ 5411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:18.089547 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:18.089564 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:18.089653 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:18.093104 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:18.093895 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:18.093909 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:18.093916 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:18.094100 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:18.094561 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:18.094566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:18.094572 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:18.095162 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:18.095563 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:18.095934 (+ 371us) server_negotiation.cc:299] Negotiation successful
0812 00:27:18.096369 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":375,"threads_started":1}
I20260812 00:27:18.105621 32172 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f54db84e67b42c3a0f314cc6196b3fa" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34891 } }
I20260812 00:27:18.106047 32172 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:18.106159 32172 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f54db84e67b42c3a0f314cc6196b3fa, State: Initialized, Role: FOLLOWER
I20260812 00:27:18.106868 32172 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f54db84e67b42c3a0f314cc6196b3fa" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34891 } }
I20260812 00:27:18.107185 32172 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:18.107342 32172 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:18.107575 32172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:18.109766 32172 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f54db84e67b42c3a0f314cc6196b3fa" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34891 } }
I20260812 00:27:18.110335 32172 leader_election.cc:302] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f54db84e67b42c3a0f314cc6196b3fa; no voters:
I20260812 00:27:18.110981 32172 leader_election.cc:288] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:18.111150 32180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:18.111994 32180 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [term 1 LEADER]: Becoming Leader. State: Replica: 6f54db84e67b42c3a0f314cc6196b3fa, State: Running, Role: LEADER
I20260812 00:27:18.112634 32180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f54db84e67b42c3a0f314cc6196b3fa" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34891 } }
I20260812 00:27:18.113420 32172 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:18.115888 32182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f54db84e67b42c3a0f314cc6196b3fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f54db84e67b42c3a0f314cc6196b3fa" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34891 } } }
I20260812 00:27:18.116093 32183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f54db84e67b42c3a0f314cc6196b3fa. Latest consensus state: current_term: 1 leader_uuid: "6f54db84e67b42c3a0f314cc6196b3fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f54db84e67b42c3a0f314cc6196b3fa" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34891 } } }
I20260812 00:27:18.116369 32182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:18.116402 32183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:18.118371 32193 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:18.123895 32193 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:18.133653 32193 catalog_manager.cc:1347] Generated new cluster ID: 3c3efbba9d62440fab335c8a0b593506
I20260812 00:27:18.133827 32193 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:18.142587 32193 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:18.144129 32193 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:18.164438 32193 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa: Generated new TSK 0
I20260812 00:27:18.165380 32193 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:27:18.231069 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:34891
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:39353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:18.600255 32208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:18.600795 32208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:18.600926 32208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:18.608490 32208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:18.608631 32208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:18.608719 32208 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:27:18.608793 32208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:18.619603 32208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:34891
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:18.620901 32208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:18.622292 32208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:18.636282 32219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:18.636345 32214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:18.636345 32215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:18.638127 32208 server_base.cc:1034] running on GCE node
I20260812 00:27:18.638846 32208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:18.639950 32208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:18.641214 32208 hybrid_clock.cc:648] HybridClock initialized: now 1786494438641152 us; error 45 us; skew 500 ppm
I20260812 00:27:18.641546 32208 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:18 dist-test-slave-c12x krb5kdc[32038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494438, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:18.644954 32208 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:27:18.646601 32208 webserver.cc:460] Webserver started at http://127.29.190.129:42119/ using document root <none> and password file <none>
I20260812 00:27:18.647361 32208 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:18.647521 32208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:18.647922 32208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:18.651003 32208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "a6c4313e6f23474a8ac01a5332e1d0e7"
format_stamp: "Formatted at 2026-08-12 00:27:18 on dist-test-slave-c12x"
server_key: "bf441d07254fbd8869d6e41dcd070fe8"
server_key_iv: "73b8c5dfe3ff71724e9c7ea0ca670a76"
server_key_version: "encryptionkey@0"
I20260812 00:27:18.651990 32208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "a6c4313e6f23474a8ac01a5332e1d0e7"
format_stamp: "Formatted at 2026-08-12 00:27:18 on dist-test-slave-c12x"
server_key: "bf441d07254fbd8869d6e41dcd070fe8"
server_key_iv: "73b8c5dfe3ff71724e9c7ea0ca670a76"
server_key_version: "encryptionkey@0"
I20260812 00:27:18.657382 32208 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:27:18.660972 32232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:18.662312 32208 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 00:27:18.662477 32208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "a6c4313e6f23474a8ac01a5332e1d0e7"
format_stamp: "Formatted at 2026-08-12 00:27:18 on dist-test-slave-c12x"
server_key: "bf441d07254fbd8869d6e41dcd070fe8"
server_key_iv: "73b8c5dfe3ff71724e9c7ea0ca670a76"
server_key_version: "encryptionkey@0"
I20260812 00:27:18.662725 32208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:18.679965 32208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:18.684613 32208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:18.684923 32208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:18.688336 32208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:18.688453 32208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:18.688588 32208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:18.688666 32208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:27:18 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494438, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:18.718509 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:18.689078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:54581 (local address 127.29.190.190:34891)
0812 00:27:18.689929 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:18.689933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:18.690885 (+ 952us) server_negotiation.cc:407] Connection header received
0812 00:27:18.693145 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:18.693153 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:18.693248 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:18.693377 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:18.695990 (+ 2613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.697325 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.701109 (+ 3784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.701908 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.702078 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:18.709188 (+ 7110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:18.709202 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:18.709209 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:18.709275 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:18.713548 (+ 4273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:18.715171 (+ 1623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:18.715180 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:18.715183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:18.715365 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:18.716129 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:18.716133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:18.716136 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:18.716538 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:18.716713 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:18.717933 (+ 1220us) server_negotiation.cc:299] Negotiation successful
0812 00:27:18.718193 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":597,"threads_started":1}
I20260812 00:27:18.720897 32245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:18.689828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34891 (local address 127.29.190.129:54581)
0812 00:27:18.690705 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:18.690756 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:18.692791 (+ 2035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:18.693658 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:18.693667 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:18.694694 (+ 1027us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:18.695668 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:18.695693 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.697559 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.697565 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:18.700857 (+ 3292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:18.700894 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.702259 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.702268 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:18.702684 (+ 416us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:18.703948 (+ 1264us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:18.703991 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:18.708751 (+ 4760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:18.713759 (+ 5008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:18.713778 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:18.713811 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:18.714929 (+ 1118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:18.715540 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:18.715546 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:18.715550 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:18.715923 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:18.716702 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:18.716716 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:18.717366 (+ 650us) client_negotiation.cc:769] Sending connection context
0812 00:27:18.717815 (+ 449us) client_negotiation.cc:240] Negotiation successful
0812 00:27:18.718742 (+ 927us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":361,"threads_started":1}
I20260812 00:27:18.734197 32208 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:39217
I20260812 00:27:18.734257 32420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:39217 every 8 connection(s)
I20260812 00:27:18.735971 32208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:18.737387 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32208
I20260812 00:27:18.737645 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:18.738449 30458 external_mini_cluster.cc:1428] Setting key 956e372d0f6597a243fcce37e72d25c2
I20260812 00:27:18.738730 32421 heartbeater.cc:347] Connected to a master server at 127.29.190.190:34891
I20260812 00:27:18.739058 32421 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:18.740928 32421 heartbeater.cc:511] Master 127.29.190.190:34891 requested a full tablet report, sending...
I20260812 00:27:18.744372 32108 ts_manager.cc:194] Registered new tserver with Master: a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217)
I20260812 00:27:18.746090 32108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:54581
I20260812 00:27:18.749384 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:18.731183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:53431 (local address 127.29.190.190:34891)
0812 00:27:18.731427 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:18.731477 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:18.731509 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:27:18.731859 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:18.731868 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:18.731989 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:18.732126 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:18.733269 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.734414 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.735935 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.736712 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.736890 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:18.741922 (+ 5032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:18.741932 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:18.741939 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:18.741986 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:18.746225 (+ 4239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:18.747197 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:18.747202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:18.747204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:18.747338 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:18.747845 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:18.747852 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:18.747860 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:18.748137 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:18.748310 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:18.748763 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 00:27:18.749012 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 00:27:18.749595 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:18.730563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34891 (local address 127.29.190.129:53431)
0812 00:27:18.731292 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:18.731328 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:18.731616 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:18.732177 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:18.732181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:18.732618 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:18.733052 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:18.733070 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.734633 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.734636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:18.735775 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:18.735790 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:18.739302 (+ 3512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:18.739311 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:18.739604 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:18.740411 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:18.740437 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:18.741677 (+ 1240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:18.746413 (+ 4736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:18.746421 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:18.746428 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:18.747051 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:18.747550 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:18.747555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:18.747558 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:18.747713 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:18.748261 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:18.748266 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:18.748477 (+ 211us) client_negotiation.cc:769] Sending connection context
0812 00:27:18.748624 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 00:27:18.749093 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"mutex_wait_us":93,"thread_start_us":331,"threads_started":1}
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:27:18.787345 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:34891
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:39353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:19.148185 32426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:19.148764 32426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:19.148945 32426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:19.156471 32426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:19.156664 32426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:19.156817 32426 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:27:19.156981 32426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:19.167587 32426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:34891
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:19.168979 32426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:19.170389 32426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:19.184317 32440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:19.184422 32435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:19.184422 32434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:19.185803 32426 server_base.cc:1034] running on GCE node
I20260812 00:27:19.186491 32426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:19.187646 32426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:19.188890 32426 hybrid_clock.cc:648] HybridClock initialized: now 1786494439188784 us; error 74 us; skew 500 ppm
I20260812 00:27:19.189343 32426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:19 dist-test-slave-c12x krb5kdc[32038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:19.192778 32426 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:27:19.194319 32426 webserver.cc:460] Webserver started at http://127.29.190.130:36933/ using document root <none> and password file <none>
I20260812 00:27:19.195009 32426 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:19.195096 32426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:19.195356 32426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:19.198426 32426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "822ed37b7b414e72965da604bbf78dc6"
format_stamp: "Formatted at 2026-08-12 00:27:19 on dist-test-slave-c12x"
server_key: "ab83525a492880fd51cdcf322db2eaea"
server_key_iv: "d3d87ea22e29bfc54163730842190ab4"
server_key_version: "encryptionkey@0"
I20260812 00:27:19.199331 32426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "822ed37b7b414e72965da604bbf78dc6"
format_stamp: "Formatted at 2026-08-12 00:27:19 on dist-test-slave-c12x"
server_key: "ab83525a492880fd51cdcf322db2eaea"
server_key_iv: "d3d87ea22e29bfc54163730842190ab4"
server_key_version: "encryptionkey@0"
I20260812 00:27:19.204957 32426 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 00:27:19.209321 32451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:19.210786 32426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:27:19.210980 32426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "822ed37b7b414e72965da604bbf78dc6"
format_stamp: "Formatted at 2026-08-12 00:27:19 on dist-test-slave-c12x"
server_key: "ab83525a492880fd51cdcf322db2eaea"
server_key_iv: "d3d87ea22e29bfc54163730842190ab4"
server_key_version: "encryptionkey@0"
I20260812 00:27:19.211236 32426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:19.226034 32426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:19.230504 32426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:19.230818 32426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:19.233671 32426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:19.233798 32426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:19.233965 32426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:19.234046 32426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:27:19 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:19.263595 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.234589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:34043 (local address 127.29.190.190:34891)
0812 00:27:19.234772 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:19.234779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:19.236400 (+ 1621us) server_negotiation.cc:407] Connection header received
0812 00:27:19.239961 (+ 3561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:19.239967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:19.240094 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:19.240199 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:19.243707 (+ 3508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.244789 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.247283 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.248026 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.248210 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.254274 (+ 6064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:19.254283 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:19.254291 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:19.254365 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:19.258471 (+ 4106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.260002 (+ 1531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.260013 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.260019 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.260242 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.261105 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.261112 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.261116 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.261611 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:19.261802 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:19.262863 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0812 00:27:19.263126 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:27:19.265224 32463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.235183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34891 (local address 127.29.190.130:34043)
0812 00:27:19.236174 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:19.236233 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:19.239317 (+ 3084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:19.240926 (+ 1609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:19.240943 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:19.242089 (+ 1146us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:19.243338 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.243375 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.244997 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.245001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.247090 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.247107 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.248352 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.248365 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.248641 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.249684 (+ 1043us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:19.249749 (+ 65us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:19.253832 (+ 4083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:19.258667 (+ 4835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:19.258679 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:19.258699 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:19.259770 (+ 1071us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:19.260421 (+ 651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:19.260433 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:19.260440 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:19.260862 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:19.261895 (+ 1033us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:19.261907 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:19.262368 (+ 461us) client_negotiation.cc:769] Sending connection context
0812 00:27:19.262726 (+ 358us) client_negotiation.cc:240] Negotiation successful
0812 00:27:19.263410 (+ 684us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":387,"threads_started":1}
I20260812 00:27:19.282214 32426 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:36635
I20260812 00:27:19.282285 32624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:36635 every 8 connection(s)
I20260812 00:27:19.283538 32426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:19.285890 32625 heartbeater.cc:347] Connected to a master server at 127.29.190.190:34891
I20260812 00:27:19.286142 32625 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:19.286877 32625 heartbeater.cc:511] Master 127.29.190.190:34891 requested a full tablet report, sending...
I20260812 00:27:19.288475 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.273185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:57411 (local address 127.29.190.190:34891)
0812 00:27:19.273468 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:19.273477 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:19.273604 (+ 127us) server_negotiation.cc:407] Connection header received
0812 00:27:19.273817 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:19.273826 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:19.273937 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:19.274081 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:19.275029 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.276383 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.278445 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.279050 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.279201 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.282082 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:19.282092 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:19.282099 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:19.282146 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:19.285424 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.286289 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.286296 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.286300 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.286440 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.286832 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.286838 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.286841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.287220 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:19.287379 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:19.287867 (+ 488us) server_negotiation.cc:299] Negotiation successful
0812 00:27:19.288096 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 00:27:19.288534 32596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.272665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34891 (local address 127.29.190.130:57411)
0812 00:27:19.273478 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:19.273499 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:19.273672 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:19.274118 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:19.274121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:19.274575 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:19.274871 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.274880 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.276567 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.276573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.278198 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.278213 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.279315 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.279325 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.279627 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.280479 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:19.280504 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:19.281839 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:19.285557 (+ 3718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:19.285561 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:19.285565 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:19.286155 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:19.286560 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:19.286565 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:19.286569 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:19.286711 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:19.287345 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:19.287350 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:19.287597 (+ 247us) client_negotiation.cc:769] Sending connection context
0812 00:27:19.287757 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 00:27:19.288101 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":624,"threads_started":1}
I20260812 00:27:19.288470 32108 ts_manager.cc:194] Registered new tserver with Master: 822ed37b7b414e72965da604bbf78dc6 (127.29.190.130:36635)
I20260812 00:27:19.289570 32108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:34043
I20260812 00:27:19.290772 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32426
I20260812 00:27:19.290995 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:19.291574 30458 external_mini_cluster.cc:1428] Setting key 81a978706302aad77be7e5180798c0c0
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:27:19.339417 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:34891
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:39353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:19.680850 32630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:19.681195 32630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:19.681375 32630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:19.689196 32630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:19.689360 32630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:19.689530 32630 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:27:19.689680 32630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:19.699982 32630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:34891
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:19.701421 32630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:19.702843 32630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:19.716835 32635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:19.716938 32638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:19.717021 32636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:19.717900 32630 server_base.cc:1034] running on GCE node
I20260812 00:27:19.718668 32630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:19.719834 32630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:19.721122 32630 hybrid_clock.cc:648] HybridClock initialized: now 1786494439721056 us; error 58 us; skew 500 ppm
I20260812 00:27:19.721470 32630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:19 dist-test-slave-c12x krb5kdc[32038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:19.724999 32630 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:27:19.726647 32630 webserver.cc:460] Webserver started at http://127.29.190.131:36693/ using document root <none> and password file <none>
I20260812 00:27:19.727402 32630 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:19.727594 32630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:19.727952 32630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:19.731240 32630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "2d9bc4f4228c4f2fb752003f6a1b0081"
format_stamp: "Formatted at 2026-08-12 00:27:19 on dist-test-slave-c12x"
server_key: "02318eb18f877685f7ce31f49cdc6455"
server_key_iv: "fcf212bf23afae28b3dc576732164977"
server_key_version: "encryptionkey@0"
I20260812 00:27:19.732194 32630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "2d9bc4f4228c4f2fb752003f6a1b0081"
format_stamp: "Formatted at 2026-08-12 00:27:19 on dist-test-slave-c12x"
server_key: "02318eb18f877685f7ce31f49cdc6455"
server_key_iv: "fcf212bf23afae28b3dc576732164977"
server_key_version: "encryptionkey@0"
I20260812 00:27:19.737602 32630 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:27:19.741380 32650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:19.742846 32630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:27:19.743033 32630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "2d9bc4f4228c4f2fb752003f6a1b0081"
format_stamp: "Formatted at 2026-08-12 00:27:19 on dist-test-slave-c12x"
server_key: "02318eb18f877685f7ce31f49cdc6455"
server_key_iv: "fcf212bf23afae28b3dc576732164977"
server_key_version: "encryptionkey@0"
I20260812 00:27:19.743278 32630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:19.750473 32421 heartbeater.cc:503] Master 127.29.190.190:34891 was elected leader, sending a full tablet report...
I20260812 00:27:19.759327 32630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:19.763808 32630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:19.764030 32630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:19.766824 32630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:19.766909 32630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:19.767055 32630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:19.767128 32630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:27:19 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:19.793895 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.767561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:60531 (local address 127.29.190.190:34891)
0812 00:27:19.767966 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:19.767972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:19.769505 (+ 1533us) server_negotiation.cc:407] Connection header received
0812 00:27:19.771773 (+ 2268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:19.771777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:19.771883 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:19.771971 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:19.774603 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.775997 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.777702 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.778444 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.778581 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.784278 (+ 5697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:19.784285 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:19.784288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:19.784324 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:19.788635 (+ 4311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.789656 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.789666 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.789672 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.789881 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.790603 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.790609 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.790613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.791090 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:19.791256 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:19.792544 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0812 00:27:19.793052 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:27:19.795022 32662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.768377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34891 (local address 127.29.190.131:60531)
0812 00:27:19.769298 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:19.769346 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:19.771385 (+ 2039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:19.772544 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:19.772557 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:19.773419 (+ 862us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:19.774351 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.774398 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.776209 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.776218 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.777550 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.777563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.778710 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.778716 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.779141 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.780269 (+ 1128us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:19.780314 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:19.784015 (+ 3701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:19.788867 (+ 4852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:19.788874 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:19.788892 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:19.789422 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:19.790085 (+ 663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:19.790091 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:19.790097 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:19.790453 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:19.791224 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:19.791233 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:19.791876 (+ 643us) client_negotiation.cc:769] Sending connection context
0812 00:27:19.792270 (+ 394us) client_negotiation.cc:240] Negotiation successful
0812 00:27:19.792951 (+ 681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":386,"threads_started":1}
I20260812 00:27:19.826025 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.806562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:42441 (local address 127.29.190.190:34891)
0812 00:27:19.806784 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:19.806795 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:19.808415 (+ 1620us) server_negotiation.cc:407] Connection header received
0812 00:27:19.808653 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:19.808662 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:19.808822 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:19.808957 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:19.810059 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.811539 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.814042 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.815047 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.815227 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.818500 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:19.818506 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:19.818510 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:19.818546 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:19.822386 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.823357 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.823366 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.823372 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.823606 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.824263 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.824270 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.824273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.824657 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:19.824841 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:19.825318 (+ 477us) server_negotiation.cc:299] Negotiation successful
0812 00:27:19.825580 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:27:19.826133 32743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.806612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34891 (local address 127.29.190.131:42441)
0812 00:27:19.808264 (+ 1652us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:19.808289 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:19.808491 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:19.809009 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:19.809014 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:19.809573 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:19.809899 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.809910 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.811738 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.811746 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.813812 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.813835 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.815264 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.815269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.815584 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.816621 (+ 1037us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:19.816658 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:19.818184 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:19.822549 (+ 4365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:19.822556 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:19.822560 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:19.823209 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:19.823752 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:19.823761 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:19.823767 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:19.824091 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:19.824805 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:19.824811 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:19.825026 (+ 215us) client_negotiation.cc:769] Sending connection context
0812 00:27:19.825208 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 00:27:19.825624 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1427,"thread_start_us":1213,"threads_started":1}
I20260812 00:27:19.840135 32630 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:34719
I20260812 00:27:19.840189 360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:34719 every 8 connection(s)
I20260812 00:27:19.841459 32630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:19.843914 361 heartbeater.cc:347] Connected to a master server at 127.29.190.190:34891
I20260812 00:27:19.844192 361 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:19.845058 361 heartbeater.cc:511] Master 127.29.190.190:34891 requested a full tablet report, sending...
I20260812 00:27:19.845064 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32630
I20260812 00:27:19.845284 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:19.845844 30458 external_mini_cluster.cc:1428] Setting key 281ba49ba5ad5cafdde41bdeb6f64e7f
I20260812 00:27:19.846807 32108 ts_manager.cc:194] Registered new tserver with Master: 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131:34719)
I20260812 00:27:19.848107 32108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:60531
I20260812 00:27:19.849335 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:27:19 dist-test-slave-c12x krb5kdc[32038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:27:19 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:19.901360 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.887334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49518 (local address 127.29.190.190:34891)
0812 00:27:19.887607 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:19.887617 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:19.887827 (+ 210us) server_negotiation.cc:407] Connection header received
0812 00:27:19.887984 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:19.887988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:19.888058 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:19.888156 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:19.889693 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.890446 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.891734 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.892137 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.892230 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.896113 (+ 3883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:19.896119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:19.896122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:19.896157 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:19.898814 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.899517 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.899521 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.899524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.899657 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:19.900001 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:19.900005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:19.900007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:19.900303 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:19.900484 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:19.900787 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 00:27:19.900960 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260812 00:27:19.905663 32107 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:27:19.912748 32107 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:19.963398 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.928528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48308 (local address 127.29.190.130:36635)
0812 00:27:19.954376 (+ 25848us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:19.954384 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:19.954411 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:27:19.954510 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:19.954522 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:19.954670 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:19.954948 (+ 278us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:19.955705 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.957255 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.960156 (+ 2901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.961753 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.961949 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.962148 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:19.962850 (+ 702us) server_negotiation.cc:299] Negotiation successful
0812 00:27:19.963070 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25682,"thread_start_us":25695,"threads_started":1}
I20260812 00:27:19.963820 377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.928909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39217 (local address 127.0.0.1:37892)
0812 00:27:19.953716 (+ 24807us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:19.953736 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:19.953883 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:19.954824 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:19.954829 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:19.954857 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:19.955455 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.955476 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.957172 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.957178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.960389 (+ 3211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.960405 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.962741 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.962749 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.962928 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.962961 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:27:19.963049 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:27:19.963201 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24678,"mutex_wait_us":146,"spinlock_wait_cycles":1280,"thread_start_us":23690,"threads_started":1}
I20260812 00:27:19.963958 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.929176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40348 (local address 127.29.190.131:34719)
0812 00:27:19.952549 (+ 23373us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:19.952561 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:19.952868 (+ 307us) server_negotiation.cc:407] Connection header received
0812 00:27:19.953197 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:19.953213 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:19.953587 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:19.955153 (+ 1566us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:19.955407 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.957215 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.960611 (+ 3396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.961645 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.961848 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.962059 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:19.963311 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0812 00:27:19.963492 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23116,"thread_start_us":22904,"threads_started":1}
I20260812 00:27:19.964118 381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.929560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37892 (local address 127.29.190.129:39217)
0812 00:27:19.951529 (+ 21969us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:19.951544 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:19.953854 (+ 2310us) server_negotiation.cc:407] Connection header received
0812 00:27:19.954076 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:19.954085 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:19.954329 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:19.954566 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:19.955721 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.956914 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.960593 (+ 3679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.962190 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.962381 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.962568 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:19.963632 (+ 1064us) server_negotiation.cc:299] Negotiation successful
0812 00:27:19.963812 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21657,"thread_start_us":21961,"threads_started":1}
I20260812 00:27:19.963232 379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.928470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:34719 (local address 127.0.0.1:40348)
0812 00:27:19.952686 (+ 24216us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:19.952706 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:19.952946 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:19.954029 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:19.954038 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:19.954078 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:19.954638 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.954655 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.957393 (+ 2738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.957400 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.960389 (+ 2989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.960405 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.962192 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.962199 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.962413 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.962477 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 00:27:19.962626 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 00:27:19.962849 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24055,"mutex_wait_us":137,"thread_start_us":24957,"threads_started":1}
I20260812 00:27:19.964458 375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:19.928340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:36635 (local address 127.0.0.1:48308)
0812 00:27:19.943329 (+ 14989us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:19.943418 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:19.943776 (+ 358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:19.954927 (+ 11151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:19.954932 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:19.954961 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:19.955515 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.955531 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.957427 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.957434 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.959955 (+ 2521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:19.959971 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:19.962318 (+ 2347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:19.962326 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:19.962540 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:19.962578 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:27:19.962676 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:27:19.963891 (+ 1215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14553,"mutex_wait_us":1064,"thread_start_us":15718,"threads_started":1}
I20260812 00:27:19.968340 32522 tablet_service.cc:1467] Processing CreateTablet for tablet 6ad8c1a9f8524e12a35320e179317c34 (DEFAULT_TABLE table=test-table [id=27bf8d496e434a2d95eea161c4cbef62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:19.968519 32313 tablet_service.cc:1467] Processing CreateTablet for tablet 6ad8c1a9f8524e12a35320e179317c34 (DEFAULT_TABLE table=test-table [id=27bf8d496e434a2d95eea161c4cbef62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:19.969730 32522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ad8c1a9f8524e12a35320e179317c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:19.969849 32313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ad8c1a9f8524e12a35320e179317c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:19.976202 32714 tablet_service.cc:1467] Processing CreateTablet for tablet 6ad8c1a9f8524e12a35320e179317c34 (DEFAULT_TABLE table=test-table [id=27bf8d496e434a2d95eea161c4cbef62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:19.977733 32714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ad8c1a9f8524e12a35320e179317c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:19.982801 382 tablet_bootstrap.cc:492] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Bootstrap starting.
I20260812 00:27:19.986696 382 tablet_bootstrap.cc:654] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:19.988121 382 log.cc:824] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:19.988382 383 tablet_bootstrap.cc:492] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Bootstrap starting.
I20260812 00:27:19.991705 382 tablet_bootstrap.cc:492] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: No bootstrap required, opened a new log
I20260812 00:27:19.991994 382 ts_tablet_manager.cc:1397] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 00:27:19.992424 383 tablet_bootstrap.cc:654] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:19.993800 383 log.cc:824] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:19.997686 383 tablet_bootstrap.cc:492] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: No bootstrap required, opened a new log
I20260812 00:27:19.998101 383 ts_tablet_manager.cc:1397] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.006s
I20260812 00:27:20.000524 382 raft_consensus.cc:348] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.001027 382 raft_consensus.cc:374] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:20.001145 382 raft_consensus.cc:729] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c4313e6f23474a8ac01a5332e1d0e7, State: Initialized, Role: FOLLOWER
I20260812 00:27:20.001916 382 consensus_queue.cc:260] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.004201 387 tablet_bootstrap.cc:492] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Bootstrap starting.
I20260812 00:27:20.006192 382 ts_tablet_manager.cc:1428] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Time spent starting tablet: real 0.014s user 0.011s sys 0.000s
I20260812 00:27:20.008188 387 tablet_bootstrap.cc:654] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:20.009672 387 log.cc:824] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:20.010546 383 raft_consensus.cc:348] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.010983 383 raft_consensus.cc:374] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:20.011129 383 raft_consensus.cc:729] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822ed37b7b414e72965da604bbf78dc6, State: Initialized, Role: FOLLOWER
I20260812 00:27:20.011869 383 consensus_queue.cc:260] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.013023 32625 heartbeater.cc:503] Master 127.29.190.190:34891 was elected leader, sending a full tablet report...
I20260812 00:27:20.013221 387 tablet_bootstrap.cc:492] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: No bootstrap required, opened a new log
I20260812 00:27:20.013587 387 ts_tablet_manager.cc:1397] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 00:27:20.013902 383 ts_tablet_manager.cc:1428] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Time spent starting tablet: real 0.016s user 0.015s sys 0.002s
I20260812 00:27:20.022485 387 raft_consensus.cc:348] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.022924 387 raft_consensus.cc:374] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:20.023047 387 raft_consensus.cc:729] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d9bc4f4228c4f2fb752003f6a1b0081, State: Initialized, Role: FOLLOWER
I20260812 00:27:20.023813 387 consensus_queue.cc:260] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.024976 361 heartbeater.cc:503] Master 127.29.190.190:34891 was elected leader, sending a full tablet report...
I20260812 00:27:20.025560 387 ts_tablet_manager.cc:1428] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
W20260812 00:27:20.035874 32626 tablet.cc:2369] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:27:20.093274 362 tablet.cc:2369] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:27:20.242060 32422 tablet.cc:2369] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:20.338392 392 raft_consensus.cc:482] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:20.338785 392 raft_consensus.cc:504] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.340713 392 leader_election.cc:288] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131:34719), a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217)
I20260812 00:27:20.348278 381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.341317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:35851 (local address 127.29.190.129:39217)
0812 00:27:20.341595 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:20.341601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:20.342245 (+ 644us) server_negotiation.cc:407] Connection header received
0812 00:27:20.342445 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:20.342449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:20.342509 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:20.342629 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:20.343339 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.344154 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.346077 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.346967 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.347159 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.347251 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:20.347894 (+ 643us) server_negotiation.cc:299] Negotiation successful
0812 00:27:20.348023 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 00:27:20.348371 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.341125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:54233 (local address 127.29.190.131:34719)
0812 00:27:20.341334 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:20.341342 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:20.342188 (+ 846us) server_negotiation.cc:407] Connection header received
0812 00:27:20.342424 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:20.342429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:20.342495 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:20.342564 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:20.343255 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.344049 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.346071 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.346932 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.347122 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.347232 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:20.347865 (+ 633us) server_negotiation.cc:299] Negotiation successful
0812 00:27:20.348043 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:27:20.348394 396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.341202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39217 (local address 127.29.190.130:35851)
0812 00:27:20.342088 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:20.342103 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:20.342276 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:20.342666 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:20.342671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:20.342696 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:20.343147 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.343156 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.344323 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.344328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.345909 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.345922 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.347402 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.347414 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.347716 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.347756 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:27:20.347853 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 00:27:20.347994 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"mutex_wait_us":81,"thread_start_us":626,"threads_started":1}
I20260812 00:27:20.348929 395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.341023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:34719 (local address 127.29.190.130:54233)
0812 00:27:20.342020 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:20.342045 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:20.342245 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:20.342618 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:20.342623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:20.342648 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:20.343096 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.343109 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.344192 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.344197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.345908 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.345920 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.347307 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.347322 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.347603 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.347687 (+ 84us) client_negotiation.cc:769] Sending connection context
0812 00:27:20.348434 (+ 747us) client_negotiation.cc:240] Negotiation successful
0812 00:27:20.348588 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"mutex_wait_us":122,"thread_start_us":499,"threads_started":1}
I20260812 00:27:20.349776 32753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ad8c1a9f8524e12a35320e179317c34" candidate_uuid: "822ed37b7b414e72965da604bbf78dc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" is_pre_election: true
I20260812 00:27:20.349738 32338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ad8c1a9f8524e12a35320e179317c34" candidate_uuid: "822ed37b7b414e72965da604bbf78dc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" is_pre_election: true
I20260812 00:27:20.350235 32753 raft_consensus.cc:2454] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822ed37b7b414e72965da604bbf78dc6 in term 0.
I20260812 00:27:20.350236 32338 raft_consensus.cc:2454] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822ed37b7b414e72965da604bbf78dc6 in term 0.
I20260812 00:27:20.350852 32455 leader_election.cc:302] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2d9bc4f4228c4f2fb752003f6a1b0081, 822ed37b7b414e72965da604bbf78dc6, a6c4313e6f23474a8ac01a5332e1d0e7; no voters:
I20260812 00:27:20.351287 392 raft_consensus.cc:2781] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:20.351435 392 raft_consensus.cc:482] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:20.351613 392 raft_consensus.cc:3037] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:20.353880 392 raft_consensus.cc:504] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.354518 392 leader_election.cc:288] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [CANDIDATE]: Term 1 election: Requested vote from peers 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131:34719), a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217)
I20260812 00:27:20.355039 32753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ad8c1a9f8524e12a35320e179317c34" candidate_uuid: "822ed37b7b414e72965da604bbf78dc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081"
I20260812 00:27:20.355091 32338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ad8c1a9f8524e12a35320e179317c34" candidate_uuid: "822ed37b7b414e72965da604bbf78dc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7"
I20260812 00:27:20.355261 32753 raft_consensus.cc:3037] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:20.355293 32338 raft_consensus.cc:3037] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:20.357409 32753 raft_consensus.cc:2454] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822ed37b7b414e72965da604bbf78dc6 in term 1.
I20260812 00:27:20.357599 32338 raft_consensus.cc:2454] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822ed37b7b414e72965da604bbf78dc6 in term 1.
I20260812 00:27:20.357878 32455 leader_election.cc:302] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d9bc4f4228c4f2fb752003f6a1b0081, 822ed37b7b414e72965da604bbf78dc6; no voters:
I20260812 00:27:20.358178 392 raft_consensus.cc:2781] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:20.358646 392 raft_consensus.cc:686] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 1 LEADER]: Becoming Leader. State: Replica: 822ed37b7b414e72965da604bbf78dc6, State: Running, Role: LEADER
I20260812 00:27:20.359130 392 consensus_queue.cc:237] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } }
I20260812 00:27:20.363957 32107 catalog_manager.cc:5495] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822ed37b7b414e72965da604bbf78dc6 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } health_report { overall_health: UNKNOWN } } }
I20260812 00:27:20.425390 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.419212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48316 (local address 127.29.190.130:36635)
0812 00:27:20.419514 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:20.419521 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:20.419908 (+ 387us) server_negotiation.cc:407] Connection header received
0812 00:27:20.420141 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:20.420145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:20.420226 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:20.420350 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:20.420805 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.421570 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.422949 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.423378 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.423591 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.424103 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:20.424752 (+ 649us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:20.424868 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:20.424999 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 00:27:20.425070 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:27:20.434027 32338 raft_consensus.cc:1261] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Refusing update from remote peer 822ed37b7b414e72965da604bbf78dc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:20.434026 32753 raft_consensus.cc:1261] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Refusing update from remote peer 822ed37b7b414e72965da604bbf78dc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:20.435067 392 consensus_queue.cc:1035] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:20.435382 398 consensus_queue.cc:1035] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:20.446684 403 mvcc.cc:205] Tried to move back new op lower bound from 7317481228007776256 to 7317481227715039232. Current Snapshot: MvccSnapshot[applied={T|T < 7317481228007776256}]
I20260812 00:27:20.466385 32107 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:20.466696 32107 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:20.470723 32107 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa: Sending DeleteTablet for 3 replicas of tablet 6ad8c1a9f8524e12a35320e179317c34
I20260812 00:27:20.472021 32714 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ad8c1a9f8524e12a35320e179317c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:20 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:40348
I20260812 00:27:20.472030 32522 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ad8c1a9f8524e12a35320e179317c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:20 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:48308
I20260812 00:27:20.472122 32313 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ad8c1a9f8524e12a35320e179317c34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:20 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:37892
I20260812 00:27:20.475495 32108 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:27:20.476363 32108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:20.483042 423 tablet_replica.cc:330] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: stopping tablet replica
I20260812 00:27:20.484433 423 raft_consensus.cc:2229] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:27:20.486747 424 tablet_replica.cc:330] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: stopping tablet replica
I20260812 00:27:20.486683 32521 tablet_service.cc:1467] Processing CreateTablet for tablet 8391ece79f8f42dd8dc5cd1549ae786b (DEFAULT_TABLE table=test-table [id=106892915a6948e4a1d221fac7057153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:20.486718 32713 tablet_service.cc:1467] Processing CreateTablet for tablet 8391ece79f8f42dd8dc5cd1549ae786b (DEFAULT_TABLE table=test-table [id=106892915a6948e4a1d221fac7057153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:20.487308 32713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8391ece79f8f42dd8dc5cd1549ae786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:20.487317 32521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8391ece79f8f42dd8dc5cd1549ae786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:20.487926 423 raft_consensus.cc:2258] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:20.489195 424 raft_consensus.cc:2229] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:20.489755 422 tablet_replica.cc:330] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: stopping tablet replica
I20260812 00:27:20.489974 424 raft_consensus.cc:2258] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:20.490320 422 raft_consensus.cc:2229] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:20.490837 422 raft_consensus.cc:2258] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:20.494722 387 tablet_bootstrap.cc:492] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: Bootstrap starting.
I20260812 00:27:20.495163 422 ts_tablet_manager.cc:1905] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:20.496659 387 tablet_bootstrap.cc:654] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:20.502315 423 ts_tablet_manager.cc:1905] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:20.503732 383 tablet_bootstrap.cc:492] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: Bootstrap starting.
I20260812 00:27:20.505539 383 tablet_bootstrap.cc:654] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:20.506604 422 ts_tablet_manager.cc:1918] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:27:20.506866 422 log.cc:1196] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/6ad8c1a9f8524e12a35320e179317c34
I20260812 00:27:20.507661 422 ts_tablet_manager.cc:1939] T 6ad8c1a9f8524e12a35320e179317c34 P 2d9bc4f4228c4f2fb752003f6a1b0081: Deleting consensus metadata
I20260812 00:27:20.510010 32082 catalog_manager.cc:4841] TS 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131:34719): tablet 6ad8c1a9f8524e12a35320e179317c34 (table test-table [id=27bf8d496e434a2d95eea161c4cbef62]) successfully deleted
I20260812 00:27:20.511893 424 ts_tablet_manager.cc:1905] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:20.511965 32313 tablet_service.cc:1467] Processing CreateTablet for tablet 8391ece79f8f42dd8dc5cd1549ae786b (DEFAULT_TABLE table=test-table [id=106892915a6948e4a1d221fac7057153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:20.512435 32313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8391ece79f8f42dd8dc5cd1549ae786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:20.520447 424 ts_tablet_manager.cc:1918] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:27:20.520696 424 log.cc:1196] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/6ad8c1a9f8524e12a35320e179317c34
I20260812 00:27:20.521335 424 ts_tablet_manager.cc:1939] T 6ad8c1a9f8524e12a35320e179317c34 P a6c4313e6f23474a8ac01a5332e1d0e7: Deleting consensus metadata
I20260812 00:27:20.523504 32083 catalog_manager.cc:4841] TS a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217): tablet 6ad8c1a9f8524e12a35320e179317c34 (table test-table [id=27bf8d496e434a2d95eea161c4cbef62]) successfully deleted
I20260812 00:27:20.529156 383 tablet_bootstrap.cc:492] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: No bootstrap required, opened a new log
I20260812 00:27:20.529336 383 ts_tablet_manager.cc:1397] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.001s
I20260812 00:27:20.530344 383 raft_consensus.cc:348] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.530705 387 tablet_bootstrap.cc:492] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: No bootstrap required, opened a new log
I20260812 00:27:20.530711 383 raft_consensus.cc:374] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:20.530826 383 raft_consensus.cc:729] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822ed37b7b414e72965da604bbf78dc6, State: Initialized, Role: FOLLOWER
I20260812 00:27:20.530872 387 ts_tablet_manager.cc:1397] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.017s
I20260812 00:27:20.531175 383 consensus_queue.cc:260] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.531934 383 ts_tablet_manager.cc:1428] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 00:27:20.531795 387 raft_consensus.cc:348] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.532033 387 raft_consensus.cc:374] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:20.532125 387 raft_consensus.cc:729] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d9bc4f4228c4f2fb752003f6a1b0081, State: Initialized, Role: FOLLOWER
I20260812 00:27:20.532379 387 consensus_queue.cc:260] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.532966 387 ts_tablet_manager.cc:1428] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:27:20.537343 428 tablet_bootstrap.cc:492] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: Bootstrap starting.
I20260812 00:27:20.537668 423 ts_tablet_manager.cc:1918] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:27:20.537868 423 log.cc:1196] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/6ad8c1a9f8524e12a35320e179317c34
I20260812 00:27:20.538552 423 ts_tablet_manager.cc:1939] T 6ad8c1a9f8524e12a35320e179317c34 P 822ed37b7b414e72965da604bbf78dc6: Deleting consensus metadata
I20260812 00:27:20.539448 428 tablet_bootstrap.cc:654] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:20.540608 32081 catalog_manager.cc:4841] TS 822ed37b7b414e72965da604bbf78dc6 (127.29.190.130:36635): tablet 6ad8c1a9f8524e12a35320e179317c34 (table test-table [id=27bf8d496e434a2d95eea161c4cbef62]) successfully deleted
I20260812 00:27:20.542057 428 tablet_bootstrap.cc:492] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: No bootstrap required, opened a new log
I20260812 00:27:20.542210 428 ts_tablet_manager.cc:1397] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 00:27:20.542881 428 raft_consensus.cc:348] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.543077 428 raft_consensus.cc:374] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:20.543195 428 raft_consensus.cc:729] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c4313e6f23474a8ac01a5332e1d0e7, State: Initialized, Role: FOLLOWER
I20260812 00:27:20.543499 428 consensus_queue.cc:260] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.544086 428 ts_tablet_manager.cc:1428] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:27:20.919029 393 raft_consensus.cc:482] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:20.919315 393 raft_consensus.cc:504] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.921066 393 leader_election.cc:288] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217), 822ed37b7b414e72965da604bbf78dc6 (127.29.190.130:36635)
I20260812 00:27:20.923023 388 raft_consensus.cc:482] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:20.923244 388 raft_consensus.cc:504] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.925403 388 leader_election.cc:288] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 822ed37b7b414e72965da604bbf78dc6 (127.29.190.130:36635), 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131:34719)
I20260812 00:27:20.930339 431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.921382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39217 (local address 127.29.190.131:44587)
0812 00:27:20.922260 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:20.922284 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:20.922442 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:20.922838 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:20.922843 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:20.922874 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:20.923277 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.923291 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.925023 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.925029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.927487 (+ 2458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.927506 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.929441 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.929448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.929635 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.929672 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:27:20.929767 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:27:20.929931 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"thread_start_us":541,"threads_started":1}
I20260812 00:27:20.930778 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.921684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:38621 (local address 127.29.190.130:36635)
0812 00:27:20.921948 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:20.921959 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:20.922910 (+ 951us) server_negotiation.cc:407] Connection header received
0812 00:27:20.923252 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:20.923261 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:20.923362 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:20.923609 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:20.924267 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.925210 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.928193 (+ 2983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.929518 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.929651 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.929722 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:20.930302 (+ 580us) server_negotiation.cc:299] Negotiation successful
0812 00:27:20.930482 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:27:20.931087 432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.921462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:44587 (local address 127.29.190.129:39217)
0812 00:27:20.922462 (+ 1000us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:20.922467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:20.922490 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:27:20.922572 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:20.922578 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:20.922647 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:20.922812 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:20.923537 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.924863 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.927713 (+ 2850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.929043 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.929251 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.929341 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:20.930575 (+ 1234us) server_negotiation.cc:299] Negotiation successful
0812 00:27:20.930718 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":871,"thread_start_us":769,"threads_started":1}
I20260812 00:27:20.932101 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.921445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:36635 (local address 127.29.190.131:38621)
0812 00:27:20.922796 (+ 1351us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:20.922816 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:20.923058 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:20.923653 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:20.923658 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:20.923686 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:20.924082 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.924092 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.925851 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.925858 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.927964 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.928018 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.929906 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.929912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.930107 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.930141 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:27:20.931543 (+ 1402us) client_negotiation.cc:240] Negotiation successful
0812 00:27:20.931721 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1210,"thread_start_us":1039,"threads_started":1}
I20260812 00:27:20.933923 32549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8391ece79f8f42dd8dc5cd1549ae786b" candidate_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822ed37b7b414e72965da604bbf78dc6" is_pre_election: true
I20260812 00:27:20.934108 32338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8391ece79f8f42dd8dc5cd1549ae786b" candidate_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" is_pre_election: true
I20260812 00:27:20.934376 32338 raft_consensus.cc:2454] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d9bc4f4228c4f2fb752003f6a1b0081 in term 0.
I20260812 00:27:20.934451 32549 raft_consensus.cc:2454] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d9bc4f4228c4f2fb752003f6a1b0081 in term 0.
I20260812 00:27:20.934958 32654 leader_election.cc:302] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d9bc4f4228c4f2fb752003f6a1b0081, a6c4313e6f23474a8ac01a5332e1d0e7; no voters:
I20260812 00:27:20.935762 393 raft_consensus.cc:2781] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:20.935909 393 raft_consensus.cc:482] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:20.936024 393 raft_consensus.cc:3037] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:20.939129 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.926210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51507 (local address 127.29.190.130:36635)
0812 00:27:20.931035 (+ 4825us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:20.931043 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:20.932103 (+ 1060us) server_negotiation.cc:407] Connection header received
0812 00:27:20.932543 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:20.932547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:20.932648 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:20.932744 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:20.933634 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.934832 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.937293 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.938090 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.938292 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.938371 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:20.938680 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 00:27:20.938818 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4704,"thread_start_us":6478,"threads_started":1}
I20260812 00:27:20.939194 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.925772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:36635 (local address 127.29.190.129:51507)
0812 00:27:20.931995 (+ 6223us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:20.932017 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:20.932388 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:20.932931 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:20.932940 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:20.932978 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:20.933438 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.933456 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.935014 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.935020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.937109 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.937122 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.938329 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.938335 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.938496 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.938522 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:27:20.938651 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 00:27:20.938804 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6093,"thread_start_us":5939,"threads_started":1}
I20260812 00:27:20.939455 393 raft_consensus.cc:504] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.939946 32549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8391ece79f8f42dd8dc5cd1549ae786b" candidate_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822ed37b7b414e72965da604bbf78dc6" is_pre_election: true
I20260812 00:27:20.940207 32549 raft_consensus.cc:2454] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6c4313e6f23474a8ac01a5332e1d0e7 in term 0.
I20260812 00:27:20.940307 393 leader_election.cc:288] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [CANDIDATE]: Term 1 election: Requested vote from peers a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217), 822ed37b7b414e72965da604bbf78dc6 (127.29.190.130:36635)
I20260812 00:27:20.940835 32338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8391ece79f8f42dd8dc5cd1549ae786b" candidate_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7"
I20260812 00:27:20.940932 32549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8391ece79f8f42dd8dc5cd1549ae786b" candidate_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822ed37b7b414e72965da604bbf78dc6"
I20260812 00:27:20.940872 32233 leader_election.cc:302] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822ed37b7b414e72965da604bbf78dc6, a6c4313e6f23474a8ac01a5332e1d0e7; no voters:
I20260812 00:27:20.941073 32338 raft_consensus.cc:3037] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:20.941138 32549 raft_consensus.cc:3037] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:20.942595 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.926344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:42945 (local address 127.29.190.131:34719)
0812 00:27:20.933249 (+ 6905us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:20.933255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:20.933669 (+ 414us) server_negotiation.cc:407] Connection header received
0812 00:27:20.933736 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:20.933743 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:20.933821 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:20.933908 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:20.935064 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.936424 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.938965 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.941402 (+ 2437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.941610 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.941686 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:20.942092 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 00:27:20.942241 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6758,"thread_start_us":6600,"threads_started":1}
I20260812 00:27:20.942638 435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:20.925986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:34719 (local address 127.29.190.129:42945)
0812 00:27:20.933401 (+ 7415us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:20.933425 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:20.933552 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:20.934175 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:20.934183 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:20.934210 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:20.934808 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.934822 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.936588 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.936593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.938747 (+ 2154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:20.938763 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:20.941657 (+ 2894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:20.941665 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:20.941878 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:20.941915 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:27:20.942043 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 00:27:20.942205 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7252,"thread_start_us":7551,"threads_started":1}
I20260812 00:27:20.944092 32753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8391ece79f8f42dd8dc5cd1549ae786b" candidate_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" is_pre_election: true
I20260812 00:27:20.944183 32338 raft_consensus.cc:2454] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d9bc4f4228c4f2fb752003f6a1b0081 in term 1.
I20260812 00:27:20.944229 32549 raft_consensus.cc:2454] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d9bc4f4228c4f2fb752003f6a1b0081 in term 1.
I20260812 00:27:20.944432 32753 raft_consensus.cc:2379] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6c4313e6f23474a8ac01a5332e1d0e7 in current term 1: Already voted for candidate 2d9bc4f4228c4f2fb752003f6a1b0081 in this term.
I20260812 00:27:20.944500 388 raft_consensus.cc:2741] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 00:27:20.944794 32654 leader_election.cc:302] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d9bc4f4228c4f2fb752003f6a1b0081, a6c4313e6f23474a8ac01a5332e1d0e7; no voters:
I20260812 00:27:20.945132 393 raft_consensus.cc:2781] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:20.945600 393 raft_consensus.cc:686] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 LEADER]: Becoming Leader. State: Replica: 2d9bc4f4228c4f2fb752003f6a1b0081, State: Running, Role: LEADER
I20260812 00:27:20.945993 393 consensus_queue.cc:237] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:20.949930 32108 catalog_manager.cc:5495] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131). New cstate: current_term: 1 leader_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } health_report { overall_health: HEALTHY } } }
Aug 12 00:27:21 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494438, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:21.105003 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.089971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34891 (local address 127.0.0.1:49520)
0812 00:27:21.090976 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:21.091006 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:21.091213 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:21.091808 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:21.091812 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:21.092650 (+ 838us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:21.092876 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:21.092886 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.094013 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.094017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:21.095051 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:21.095064 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.095941 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.095950 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:21.096076 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.096803 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:21.096822 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:21.099378 (+ 2556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:21.102503 (+ 3125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:21.102515 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:21.102521 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:21.102987 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:21.103323 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:21.103326 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:21.103329 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:21.103554 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:21.104080 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:21.104087 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:21.104248 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 00:27:21.104397 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 00:27:21.104649 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"thread_start_us":554,"threads_started":1}
I20260812 00:27:21.105108 450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.090064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49520 (local address 127.29.190.190:34891)
0812 00:27:21.091008 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.091015 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.091114 (+ 99us) server_negotiation.cc:407] Connection header received
0812 00:27:21.091363 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.091369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.091502 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.091632 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:21.093075 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.093858 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.095179 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.095779 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.095878 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.099657 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:21.099663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:21.099666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:21.099697 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:21.102336 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.103100 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.103103 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.103106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.103222 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.103660 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.103664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.103666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.103960 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:21.104073 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.104488 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.104791 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":825,"thread_start_us":552,"threads_started":1}
I20260812 00:27:21.110503 32108 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:49520:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:27:21.111653 32108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:21.119400 32313 tablet_service.cc:1467] Processing CreateTablet for tablet 20039a22c6674eb7990dc3fef8acd325 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=92a42d5bdb92414181285c8c6810ca7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:27:21.119508 32521 tablet_service.cc:1467] Processing CreateTablet for tablet 20039a22c6674eb7990dc3fef8acd325 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=92a42d5bdb92414181285c8c6810ca7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:27:21.119845 32713 tablet_service.cc:1467] Processing CreateTablet for tablet 20039a22c6674eb7990dc3fef8acd325 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=92a42d5bdb92414181285c8c6810ca7b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:27:21.120038 32313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20039a22c6674eb7990dc3fef8acd325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:21.120146 32521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20039a22c6674eb7990dc3fef8acd325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:21.120370 32713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20039a22c6674eb7990dc3fef8acd325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:21.127372 453 tablet_bootstrap.cc:492] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: Bootstrap starting.
I20260812 00:27:21.128266 455 tablet_bootstrap.cc:492] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: Bootstrap starting.
I20260812 00:27:21.130246 455 tablet_bootstrap.cc:654] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:21.130246 453 tablet_bootstrap.cc:654] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:21.132895 455 tablet_bootstrap.cc:492] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: No bootstrap required, opened a new log
I20260812 00:27:21.132974 453 tablet_bootstrap.cc:492] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: No bootstrap required, opened a new log
I20260812 00:27:21.133095 455 ts_tablet_manager.cc:1397] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260812 00:27:21.133113 453 ts_tablet_manager.cc:1397] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260812 00:27:21.133962 453 raft_consensus.cc:348] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.133970 455 raft_consensus.cc:348] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.134243 455 raft_consensus.cc:374] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:21.134243 453 raft_consensus.cc:374] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:21.134356 453 raft_consensus.cc:729] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c4313e6f23474a8ac01a5332e1d0e7, State: Initialized, Role: FOLLOWER
I20260812 00:27:21.134356 455 raft_consensus.cc:729] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d9bc4f4228c4f2fb752003f6a1b0081, State: Initialized, Role: FOLLOWER
I20260812 00:27:21.134498 454 tablet_bootstrap.cc:492] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: Bootstrap starting.
I20260812 00:27:21.134632 455 consensus_queue.cc:260] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.134697 453 consensus_queue.cc:260] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.135392 453 ts_tablet_manager.cc:1428] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260812 00:27:21.135221 393 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.135259 388 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.135586 393 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:21.135635 388 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:21.136313 454 tablet_bootstrap.cc:654] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:21.136499 455 ts_tablet_manager.cc:1428] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 00:27:21.139111 454 tablet_bootstrap.cc:492] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: No bootstrap required, opened a new log
I20260812 00:27:21.139295 454 ts_tablet_manager.cc:1397] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260812 00:27:21.140069 454 raft_consensus.cc:348] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.140365 454 raft_consensus.cc:374] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:21.140518 454 raft_consensus.cc:729] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822ed37b7b414e72965da604bbf78dc6, State: Initialized, Role: FOLLOWER
I20260812 00:27:21.140791 454 consensus_queue.cc:260] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.141603 454 ts_tablet_manager.cc:1428] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:27:21.141494 462 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.141844 462 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:21.250911 462 raft_consensus.cc:482] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:21.251170 462 raft_consensus.cc:504] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.252019 462 leader_election.cc:288] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217), 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131:34719)
I20260812 00:27:21.252611 32753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20039a22c6674eb7990dc3fef8acd325" candidate_uuid: "822ed37b7b414e72965da604bbf78dc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" is_pre_election: true
I20260812 00:27:21.252631 32338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20039a22c6674eb7990dc3fef8acd325" candidate_uuid: "822ed37b7b414e72965da604bbf78dc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" is_pre_election: true
I20260812 00:27:21.252863 32753 raft_consensus.cc:2454] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822ed37b7b414e72965da604bbf78dc6 in term 0.
I20260812 00:27:21.252924 32338 raft_consensus.cc:2454] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822ed37b7b414e72965da604bbf78dc6 in term 0.
I20260812 00:27:21.253345 32455 leader_election.cc:302] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d9bc4f4228c4f2fb752003f6a1b0081, 822ed37b7b414e72965da604bbf78dc6; no voters:
I20260812 00:27:21.253628 462 raft_consensus.cc:2781] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:21.253734 462 raft_consensus.cc:482] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:21.253872 462 raft_consensus.cc:3037] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:21.256011 462 raft_consensus.cc:504] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.256620 462 leader_election.cc:288] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [CANDIDATE]: Term 1 election: Requested vote from peers a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217), 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131:34719)
I20260812 00:27:21.257195 32338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20039a22c6674eb7990dc3fef8acd325" candidate_uuid: "822ed37b7b414e72965da604bbf78dc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7"
I20260812 00:27:21.257221 32753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20039a22c6674eb7990dc3fef8acd325" candidate_uuid: "822ed37b7b414e72965da604bbf78dc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081"
I20260812 00:27:21.257431 32338 raft_consensus.cc:3037] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:21.257452 32753 raft_consensus.cc:3037] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:21.259574 32338 raft_consensus.cc:2454] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822ed37b7b414e72965da604bbf78dc6 in term 1.
I20260812 00:27:21.259874 32753 raft_consensus.cc:2454] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822ed37b7b414e72965da604bbf78dc6 in term 1.
I20260812 00:27:21.260066 32457 leader_election.cc:302] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822ed37b7b414e72965da604bbf78dc6, a6c4313e6f23474a8ac01a5332e1d0e7; no voters:
I20260812 00:27:21.260408 462 raft_consensus.cc:2781] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:21.260812 462 raft_consensus.cc:686] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [term 1 LEADER]: Becoming Leader. State: Replica: 822ed37b7b414e72965da604bbf78dc6, State: Running, Role: LEADER
I20260812 00:27:21.261108 462 consensus_queue.cc:237] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } }
I20260812 00:27:21.262948 463 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: TxnStatusTablet state changed. Reason: New leader 822ed37b7b414e72965da604bbf78dc6. Latest consensus state: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.263408 463 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:27:21.264186 466 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:27:21.264464 466 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:27:21.264714 32107 catalog_manager.cc:5495] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822ed37b7b414e72965da604bbf78dc6 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } health_report { overall_health: UNKNOWN } } }
I20260812 00:27:21.298290 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.290956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:36635 (local address 127.0.0.1:48332)
0812 00:27:21.291219 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:21.291239 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:21.291391 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:21.291868 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:21.291873 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:21.291887 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:21.292090 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:21.292100 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.293786 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.293793 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:21.295476 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:21.295495 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.296761 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.296768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:21.297005 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.297102 (+ 97us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:21.297655 (+ 553us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:21.297684 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 00:27:21.297770 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:27:21.297952 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 00:27:21.298995 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.290893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48332 (local address 127.29.190.130:36635)
0812 00:27:21.291084 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.291090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.291340 (+ 250us) server_negotiation.cc:407] Connection header received
0812 00:27:21.291606 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.291613 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.291713 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.291838 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:21.292260 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.293619 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.295661 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.296562 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.296722 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.297330 (+ 608us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:21.297496 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:21.297595 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.298596 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.298719 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 00:27:21.312000 32338 raft_consensus.cc:1261] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Refusing update from remote peer 822ed37b7b414e72965da604bbf78dc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:21.312057 32753 raft_consensus.cc:1261] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Refusing update from remote peer 822ed37b7b414e72965da604bbf78dc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:21.312862 463 consensus_queue.cc:1035] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:21.316694 462 consensus_queue.cc:1035] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:21.317036 388 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: TxnStatusTablet state changed. Reason: New leader 822ed37b7b414e72965da604bbf78dc6. Latest consensus state: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.317497 388 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:21.334086 463 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.335647 463 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:27:21.346909 388 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.347332 388 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P a6c4313e6f23474a8ac01a5332e1d0e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:21.356385 393 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: TxnStatusTablet state changed. Reason: New leader 822ed37b7b414e72965da604bbf78dc6. Latest consensus state: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.356757 393 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:21.357687 463 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.357982 463 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P 822ed37b7b414e72965da604bbf78dc6: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:27:21.359321 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.342733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40352 (local address 127.29.190.131:34719)
0812 00:27:21.343028 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.343038 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.345683 (+ 2645us) server_negotiation.cc:407] Connection header received
0812 00:27:21.347084 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.347090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.347220 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.347363 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:21.348289 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.349505 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.354843 (+ 5338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.355635 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.355785 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.357644 (+ 1859us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:21.358447 (+ 803us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:21.358598 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.358925 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.359024 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:27:21.361397 393 consensus_queue.cc:1035] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:21.370539 442 tablet_replica.cc:439] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "822ed37b7b414e72965da604bbf78dc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6c4313e6f23474a8ac01a5332e1d0e7" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39217 } } peers { permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 } } peers { permanent_uuid: "2d9bc4f4228c4f2fb752003f6a1b0081" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34719 } } }
I20260812 00:27:21.371002 442 tablet_replica.cc:442] T 20039a22c6674eb7990dc3fef8acd325 P 2d9bc4f4228c4f2fb752003f6a1b0081: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:21.380389 393 consensus_queue.cc:1035] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822ed37b7b414e72965da604bbf78dc6" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:21.393199 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.387213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:42331 (local address 127.29.190.130:36635)
0812 00:27:21.387388 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.387394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.388110 (+ 716us) server_negotiation.cc:407] Connection header received
0812 00:27:21.388333 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.388338 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.388428 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.388497 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:21.389094 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.389872 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.391270 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.391836 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.391982 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.392457 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:21.392564 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:21.392677 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.392819 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.392897 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:27:21.393337 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.386804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:36635 (local address 127.29.190.131:42331)
0812 00:27:21.387957 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:21.387982 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:21.388155 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:21.388646 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:21.388650 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:21.388660 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:21.388939 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:21.388947 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.390025 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.390031 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:21.391121 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:21.391134 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.392043 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.392054 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:21.392191 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.392248 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:21.392675 (+ 427us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:21.392689 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:27:21.392795 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:27:21.392946 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":959,"thread_start_us":807,"threads_started":1}
I20260812 00:27:21.442513 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.432218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:47117 (local address 127.29.190.131:34719)
0812 00:27:21.432390 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.432402 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.436121 (+ 3719us) server_negotiation.cc:407] Connection header received
0812 00:27:21.436362 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.436367 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.436457 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.436557 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:21.437264 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.438317 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.440607 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.441043 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.441185 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.441741 (+ 556us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:21.441866 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:21.441953 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.442123 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.442206 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:27:21.442951 492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.432150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:34719 (local address 127.29.190.130:47117)
0812 00:27:21.436006 (+ 3856us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:21.436023 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:21.436213 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:21.436599 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:21.436604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:21.436618 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:21.437106 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:21.437119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.438474 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.438480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:21.440447 (+ 1967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:21.440465 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.441255 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.441267 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:21.441459 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.441543 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:21.441968 (+ 425us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:21.441980 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:27:21.442078 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:27:21.442247 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3636,"thread_start_us":3498,"threads_started":1}
I20260812 00:27:21.484028 32107 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:21.484356 32107 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:21.488543 32107 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f54db84e67b42c3a0f314cc6196b3fa: Sending DeleteTablet for 3 replicas of tablet 8391ece79f8f42dd8dc5cd1549ae786b
I20260812 00:27:21.489545 32313 tablet_service.cc:1514] Processing DeleteTablet for tablet 8391ece79f8f42dd8dc5cd1549ae786b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:21 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:37892
I20260812 00:27:21.489825 32713 tablet_service.cc:1514] Processing DeleteTablet for tablet 8391ece79f8f42dd8dc5cd1549ae786b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:21 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:40348
I20260812 00:27:21.490947 32521 tablet_service.cc:1514] Processing DeleteTablet for tablet 8391ece79f8f42dd8dc5cd1549ae786b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:21 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:48308
I20260812 00:27:21.510167 499 tablet_replica.cc:330] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: stopping tablet replica
I20260812 00:27:21.511744 499 raft_consensus.cc:2229] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:27:21.511981 503 tablet_replica.cc:330] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: stopping tablet replica
I20260812 00:27:21.512244 503 raft_consensus.cc:2229] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:21.512591 503 raft_consensus.cc:2258] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:21.514271 499 raft_consensus.cc:2258] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:21.514356 495 tablet_replica.cc:330] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: stopping tablet replica
I20260812 00:27:21.514580 495 raft_consensus.cc:2229] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:21.515120 503 ts_tablet_manager.cc:1905] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:21.516042 495 raft_consensus.cc:2258] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:21.517261 495 ts_tablet_manager.cc:1905] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:21.521154 499 ts_tablet_manager.cc:1905] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:21.528551 503 ts_tablet_manager.cc:1918] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:21.536123 499 ts_tablet_manager.cc:1918] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:21.536419 503 log.cc:1196] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/8391ece79f8f42dd8dc5cd1549ae786b
I20260812 00:27:21.537262 503 ts_tablet_manager.cc:1939] T 8391ece79f8f42dd8dc5cd1549ae786b P 822ed37b7b414e72965da604bbf78dc6: Deleting consensus metadata
I20260812 00:27:21.538766 32081 catalog_manager.cc:4841] TS 822ed37b7b414e72965da604bbf78dc6 (127.29.190.130:36635): tablet 8391ece79f8f42dd8dc5cd1549ae786b (table test-table [id=106892915a6948e4a1d221fac7057153]) successfully deleted
I20260812 00:27:21.539131 499 log.cc:1196] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/8391ece79f8f42dd8dc5cd1549ae786b
I20260812 00:27:21.539768 499 ts_tablet_manager.cc:1939] T 8391ece79f8f42dd8dc5cd1549ae786b P 2d9bc4f4228c4f2fb752003f6a1b0081: Deleting consensus metadata
I20260812 00:27:21.541136 32082 catalog_manager.cc:4841] TS 2d9bc4f4228c4f2fb752003f6a1b0081 (127.29.190.131:34719): tablet 8391ece79f8f42dd8dc5cd1549ae786b (table test-table [id=106892915a6948e4a1d221fac7057153]) successfully deleted
I20260812 00:27:21.542510 495 ts_tablet_manager.cc:1918] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:21.542665 495 log.cc:1196] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/8391ece79f8f42dd8dc5cd1549ae786b
I20260812 00:27:21.543164 495 ts_tablet_manager.cc:1939] T 8391ece79f8f42dd8dc5cd1549ae786b P a6c4313e6f23474a8ac01a5332e1d0e7: Deleting consensus metadata
I20260812 00:27:21.544484 32083 catalog_manager.cc:4841] TS a6c4313e6f23474a8ac01a5332e1d0e7 (127.29.190.129:39217): tablet 8391ece79f8f42dd8dc5cd1549ae786b (table test-table [id=106892915a6948e4a1d221fac7057153]) successfully deleted
Aug 12 00:27:21 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:21.556890 505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.515083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37904 (local address 127.29.190.129:39217)
0812 00:27:21.529773 (+ 14690us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.529780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.529805 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:27:21.529870 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.529875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.529993 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.530130 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:21.532576 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.533783 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.535767 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.536504 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.536636 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.548616 (+ 11980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:21.548640 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:21.548665 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:21.548720 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:21.553258 (+ 4538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.554296 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.554308 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.554311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.554518 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.554972 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.554978 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.554982 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.555532 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:21.555861 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.556196 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.556475 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14569,"thread_start_us":14428,"threads_started":1}
W20260812 00:27:21.558149 32410 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37904
I20260812 00:27:21.580564 450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.561737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49534 (local address 127.29.190.190:34891)
0812 00:27:21.561962 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.561969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.563984 (+ 2015us) server_negotiation.cc:407] Connection header received
0812 00:27:21.564183 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.564189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.564284 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.564402 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:21.566359 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.567621 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.569620 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.570311 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.570461 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.573815 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:21.573823 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:21.573829 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:21.573878 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:21.577494 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.578348 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.578354 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.578357 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.578527 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.578948 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.578953 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.578956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.579327 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:21.579640 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.579985 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.580224 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 00:27:21.581507 32107 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49534
I20260812 00:27:21.584010 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32208
I20260812 00:27:21.603938 505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.585824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37910 (local address 127.29.190.129:39217)
0812 00:27:21.586049 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.586055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.586943 (+ 888us) server_negotiation.cc:407] Connection header received
0812 00:27:21.587383 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.587390 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.587532 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.587611 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:21.589364 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.590504 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.592423 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.593123 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.593238 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.596588 (+ 3350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:21.596595 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:21.596600 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:21.596645 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:21.600338 (+ 3693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.601192 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.601198 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.601202 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.601358 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.601780 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.601786 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.601789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.602135 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:21.602394 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.602797 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.603592 (+ 795us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260812 00:27:21.604983 32410 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37910
W20260812 00:27:21.605665 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32208: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:21.605865 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32208
I20260812 00:27:21.641053 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32426
Aug 12 00:27:21 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:27:21.662549 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.641938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48334 (local address 127.29.190.130:36635)
0812 00:27:21.642363 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.642369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.642398 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:27:21.642486 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.642492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.642582 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.642700 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:21.644428 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.645679 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.647712 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.648541 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.648674 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.654291 (+ 5617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:21.654312 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:21.654336 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:21.654398 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:21.658893 (+ 4495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.659880 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.659891 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.659895 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.660069 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.660533 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.660539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.660543 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.661141 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:21.661530 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.661870 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.662140 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267}
W20260812 00:27:21.663681 32618 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48334
W20260812 00:27:21.664520 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32426: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:21.664716 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32426
I20260812 00:27:21.703130 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32630
Aug 12 00:27:21 dist-test-slave-c12x krb5kdc[32038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:27:21.722743 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:21.704008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40362 (local address 127.29.190.131:34719)
0812 00:27:21.704235 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:21.704243 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:21.704402 (+ 159us) server_negotiation.cc:407] Connection header received
0812 00:27:21.704638 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:21.704643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:21.704712 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:21.704838 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:21.706582 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.707537 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.709033 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:21.709573 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:21.709739 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:21.715154 (+ 5415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:21.715172 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:21.715190 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:21.715234 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:21.719130 (+ 3896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.720082 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.720091 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.720093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.720305 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:21.720881 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:21.720894 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:21.720897 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:21.721379 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:21.721736 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:21.722059 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 00:27:21.722303 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260812 00:27:21.723687 352 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40362
W20260812 00:27:21.724435 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32630: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:21.724610 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32630
I20260812 00:27:21.750864 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32058
I20260812 00:27:21.752177 32167 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:21.871219 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32058
2026-08-12T00:27:21Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5806 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:21 dist-test-slave-c12x krb5kdc[519](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:21 dist-test-slave-c12x krb5kdc[519](info): set up 2 sockets
Aug 12 00:27:21 dist-test-slave-c12x krb5kdc[519](info): commencing operation
krb5kdc: starting...
W20260812 00:27:23.205006 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:23 dist-test-slave-c12x krb5kdc[519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:23.424866 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:32995
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:32995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:23.780505 540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:23.780839 540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:23.781013 540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:23.788493 540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:23.788621 540 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:27:23.788702 540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:23.788800 540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:23.788889 540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:23.789007 540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:23.799165 540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:32995
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:32995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:23.800714 540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:23.802192 540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:23.815160 547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:23.815254 548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:23.815318 550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:23.816329 540 server_base.cc:1034] running on GCE node
I20260812 00:27:23.817189 540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:23.818727 540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:23.819981 540 hybrid_clock.cc:648] HybridClock initialized: now 1786494443819918 us; error 46 us; skew 500 ppm
I20260812 00:27:23.820344 540 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:23 dist-test-slave-c12x krb5kdc[519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494443, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:23.823839 540 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:23.825470 540 webserver.cc:460] Webserver started at http://127.29.190.190:35137/ using document root <none> and password file <none>
I20260812 00:27:23.826201 540 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:23.826293 540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:23.826560 540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:23.829869 540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "98910580b3af4236a88510c8192eaaa0"
format_stamp: "Formatted at 2026-08-12 00:27:23 on dist-test-slave-c12x"
server_key: "e1f6877f0053905a1b675255e58a6c17"
server_key_iv: "aacea530c50d963bb37cb5149537ccf6"
server_key_version: "encryptionkey@0"
I20260812 00:27:23.830677 540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "98910580b3af4236a88510c8192eaaa0"
format_stamp: "Formatted at 2026-08-12 00:27:23 on dist-test-slave-c12x"
server_key: "e1f6877f0053905a1b675255e58a6c17"
server_key_iv: "aacea530c50d963bb37cb5149537ccf6"
server_key_version: "encryptionkey@0"
I20260812 00:27:23.836907 540 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:27:23.841101 563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:23.842813 540 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:27:23.843068 540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "98910580b3af4236a88510c8192eaaa0"
format_stamp: "Formatted at 2026-08-12 00:27:23 on dist-test-slave-c12x"
server_key: "e1f6877f0053905a1b675255e58a6c17"
server_key_iv: "aacea530c50d963bb37cb5149537ccf6"
server_key_version: "encryptionkey@0"
I20260812 00:27:23.843370 540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:23.869768 540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:23.874866 540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:23.875207 540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:23.900355 540 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:32995
I20260812 00:27:23.900409 637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:32995 every 8 connection(s)
I20260812 00:27:23.901960 540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:23.906085 639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:23.906816 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 540
I20260812 00:27:23.907037 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:23.907788 30458 external_mini_cluster.cc:1428] Setting key cbdcad552a79ba70314d787fcfa0463d
I20260812 00:27:23.921061 639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: Bootstrap starting.
Aug 12 00:27:23 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:23.925127 639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:23.926426 639 log.cc:824] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:23.929545 639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: No bootstrap required, opened a new log
I20260812 00:27:23.932121 643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:23.910078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37692 (local address 127.29.190.190:32995)
0812 00:27:23.910986 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:23.910999 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:23.911042 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:27:23.912782 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:23.912808 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:23.913228 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:23.913589 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:23.915548 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:23.916880 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:23.918734 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:23.919416 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:23.919637 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:23.924402 (+ 4765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:23.924410 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:23.924426 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:23.924468 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:23.927771 (+ 3303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:23.928511 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:23.928519 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:23.928526 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:23.928713 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:23.929177 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:23.929182 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:23.929187 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:23.929789 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:23.930124 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:23.930566 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 00:27:23.931010 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":400,"threads_started":1}
I20260812 00:27:23.937882 639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98910580b3af4236a88510c8192eaaa0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32995 } }
I20260812 00:27:23.938295 639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:23.938407 639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98910580b3af4236a88510c8192eaaa0, State: Initialized, Role: FOLLOWER
I20260812 00:27:23.939157 639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98910580b3af4236a88510c8192eaaa0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32995 } }
I20260812 00:27:23.939589 639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:23.939755 639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:23.939937 639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:23.942246 639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98910580b3af4236a88510c8192eaaa0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32995 } }
I20260812 00:27:23.942855 639 leader_election.cc:302] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98910580b3af4236a88510c8192eaaa0; no voters:
I20260812 00:27:23.943650 639 leader_election.cc:288] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:23.943856 645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:23.944844 645 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [term 1 LEADER]: Becoming Leader. State: Replica: 98910580b3af4236a88510c8192eaaa0, State: Running, Role: LEADER
I20260812 00:27:23.946044 639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:23.946403 645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98910580b3af4236a88510c8192eaaa0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32995 } }
I20260812 00:27:23.953377 647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98910580b3af4236a88510c8192eaaa0. Latest consensus state: current_term: 1 leader_uuid: "98910580b3af4236a88510c8192eaaa0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98910580b3af4236a88510c8192eaaa0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32995 } } }
I20260812 00:27:23.953994 646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98910580b3af4236a88510c8192eaaa0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98910580b3af4236a88510c8192eaaa0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32995 } } }
I20260812 00:27:23.954378 646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:23.954380 647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0 [sys.catalog]: This master's current role is: LEADER
W20260812 00:27:23.959465 665 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:27:23.959613 665 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:27:23.959748 666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:23.961470 666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:23.970088 666 catalog_manager.cc:1347] Generated new cluster ID: faf4905f2e6d4b5d8f5560148ccc62e9
I20260812 00:27:23.970227 666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:23.980986 666 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:23.982388 666 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:23.994635 666 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: Generated new TSK 0
I20260812 00:27:23.995708 666 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:27:24.056944 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32995
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:24.408397 675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:24.408756 675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:24.408934 675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:24.416618 675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:24.416810 675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:24.416957 675 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:27:24.417060 675 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:27:24.417191 675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:24.427619 675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:32995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:24.429091 675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:24.430536 675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:24.444783 682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:24.444783 684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:24.445694 686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:24.446133 675 server_base.cc:1034] running on GCE node
I20260812 00:27:24.446874 675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:24.448588 675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:24.449815 675 hybrid_clock.cc:648] HybridClock initialized: now 1786494444449761 us; error 63 us; skew 500 ppm
I20260812 00:27:24.450166 675 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:24 dist-test-slave-c12x krb5kdc[519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494444, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:24.453809 675 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:27:24.455689 675 webserver.cc:460] Webserver started at http://127.29.190.129:40899/ using document root <none> and password file <none>
I20260812 00:27:24.456457 675 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:24.456619 675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:24.456979 675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:24.460449 675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "ac8f949882c14a1f95d283300fa1be87"
format_stamp: "Formatted at 2026-08-12 00:27:24 on dist-test-slave-c12x"
server_key: "25a4ce1377fea6500b502f33b34febf5"
server_key_iv: "f01a9fc75b3eb9ff0d917e99426c44b2"
server_key_version: "encryptionkey@0"
I20260812 00:27:24.461324 675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "ac8f949882c14a1f95d283300fa1be87"
format_stamp: "Formatted at 2026-08-12 00:27:24 on dist-test-slave-c12x"
server_key: "25a4ce1377fea6500b502f33b34febf5"
server_key_iv: "f01a9fc75b3eb9ff0d917e99426c44b2"
server_key_version: "encryptionkey@0"
I20260812 00:27:24.467355 675 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260812 00:27:24.471426 697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:24.473253 675 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:27:24.473485 675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "ac8f949882c14a1f95d283300fa1be87"
format_stamp: "Formatted at 2026-08-12 00:27:24 on dist-test-slave-c12x"
server_key: "25a4ce1377fea6500b502f33b34febf5"
server_key_iv: "f01a9fc75b3eb9ff0d917e99426c44b2"
server_key_version: "encryptionkey@0"
I20260812 00:27:24.473732 675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:24.488139 675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:24.493033 675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:24.493369 675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:24.496382 675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:24.496529 675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:24.496663 675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:24.496762 675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:27:24 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494444, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:24.525147 710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:24.497684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:56767 (local address 127.29.190.190:32995)
0812 00:27:24.498180 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:24.498188 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:24.499466 (+ 1278us) server_negotiation.cc:407] Connection header received
0812 00:27:24.502718 (+ 3252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:24.502725 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:24.502823 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:24.502981 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:24.505565 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:24.507119 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:24.510216 (+ 3097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:24.511023 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:24.511188 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:24.516632 (+ 5444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:24.516638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:24.516641 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:24.516704 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:24.520297 (+ 3593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:24.521474 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:24.521478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:24.521480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:24.521645 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:24.522356 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:24.522366 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:24.522371 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:24.522809 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:24.522994 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:24.524369 (+ 1375us) server_negotiation.cc:299] Negotiation successful
0812 00:27:24.524664 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":238,"threads_started":1}
I20260812 00:27:24.527702 711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:24.498148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32995 (local address 127.29.190.129:56767)
0812 00:27:24.499235 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:24.499292 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:24.502066 (+ 2774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:24.503244 (+ 1178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:24.503252 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:24.504146 (+ 894us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:24.505197 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:24.505228 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:24.507465 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:24.507471 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:24.510035 (+ 2564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:24.510050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:24.511358 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:24.511369 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:24.511721 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:24.512556 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:24.512581 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:24.516325 (+ 3744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:24.520548 (+ 4223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:24.520558 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:24.520591 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:24.521286 (+ 695us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:24.521780 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:24.521788 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:24.521792 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:24.522167 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:24.523107 (+ 940us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:24.523119 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:24.523782 (+ 663us) client_negotiation.cc:769] Sending connection context
0812 00:27:24.524202 (+ 420us) client_negotiation.cc:240] Negotiation successful
0812 00:27:24.525019 (+ 817us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":459,"threads_started":1}
I20260812 00:27:24.546519 675 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:46347
I20260812 00:27:24.546626 864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:46347 every 8 connection(s)
I20260812 00:27:24.548213 675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:24.550314 710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:24.534650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51963 (local address 127.29.190.190:32995)
0812 00:27:24.534823 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:24.534827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:24.535521 (+ 694us) server_negotiation.cc:407] Connection header received
0812 00:27:24.535763 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:24.535773 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:24.535873 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:24.535986 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:24.537751 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:24.538874 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:24.540620 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:24.541099 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:24.541238 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:24.543195 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:24.543200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:24.543203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:24.543236 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:24.546854 (+ 3618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:24.547806 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:24.547812 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:24.547815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:24.548014 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:24.548426 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:24.548432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:24.548435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:24.548944 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:24.549191 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:24.549637 (+ 446us) server_negotiation.cc:299] Negotiation successful
0812 00:27:24.549879 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:27:24.550365 839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:24.534714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32995 (local address 127.29.190.129:51963)
0812 00:27:24.535373 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:24.535390 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:24.535597 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:24.536200 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:24.536205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:24.536987 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:24.537545 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:24.537566 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:24.539020 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:24.539027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:24.540368 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:24.540384 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:24.541318 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:24.541324 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:24.541489 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:24.542235 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:24.542252 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:24.542988 (+ 736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:24.547028 (+ 4040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:24.547034 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:24.547038 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:24.547624 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:24.548147 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:24.548150 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:24.548152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:24.548314 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:24.549136 (+ 822us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:24.549141 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:24.549353 (+ 212us) client_negotiation.cc:769] Sending connection context
0812 00:27:24.549495 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 00:27:24.549883 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":374,"threads_started":1}
I20260812 00:27:24.551522 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 675
I20260812 00:27:24.551738 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:24.552498 30458 external_mini_cluster.cc:1428] Setting key 0f8ee4395dd48c7a217a05199965c1df
I20260812 00:27:24.553128 865 heartbeater.cc:347] Connected to a master server at 127.29.190.190:32995
I20260812 00:27:24.554673 865 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:24.555557 865 heartbeater.cc:511] Master 127.29.190.190:32995 requested a full tablet report, sending...
I20260812 00:27:24.558022 584 ts_manager.cc:194] Registered new tserver with Master: ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347)
I20260812 00:27:24.560235 584 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:56767
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:27:24.603375 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32995
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:24.950671 871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:24.951030 871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:24.951223 871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:24.963287 871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:24.963474 871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:24.963634 871 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:27:24.963721 871 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:27:24.963850 871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:24.974757 871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:32995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:24.976214 871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:24.977635 871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:24.991549 878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:24.991647 881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:24.991674 883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:24.992369 871 server_base.cc:1034] running on GCE node
I20260812 00:27:24.993067 871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:24.994097 871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:24.995337 871 hybrid_clock.cc:648] HybridClock initialized: now 1786494444995280 us; error 72 us; skew 500 ppm
I20260812 00:27:24.995708 871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:24 dist-test-slave-c12x krb5kdc[519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494444, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:24.998863 871 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:27:25.000363 871 webserver.cc:460] Webserver started at http://127.29.190.130:46549/ using document root <none> and password file <none>
I20260812 00:27:25.001035 871 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:25.001138 871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:25.001401 871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:25.004467 871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "2dcf04bbdcae45b1a39c05665c8f0134"
format_stamp: "Formatted at 2026-08-12 00:27:24 on dist-test-slave-c12x"
server_key: "0cca63f94aed1862318c4fadeaca5217"
server_key_iv: "44a816aa6efa9684019acdc30a6ccefa"
server_key_version: "encryptionkey@0"
I20260812 00:27:25.005190 871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "2dcf04bbdcae45b1a39c05665c8f0134"
format_stamp: "Formatted at 2026-08-12 00:27:24 on dist-test-slave-c12x"
server_key: "0cca63f94aed1862318c4fadeaca5217"
server_key_iv: "44a816aa6efa9684019acdc30a6ccefa"
server_key_version: "encryptionkey@0"
I20260812 00:27:25.010447 871 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:27:25.014124 896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:25.015508 871 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:27:25.015700 871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "2dcf04bbdcae45b1a39c05665c8f0134"
format_stamp: "Formatted at 2026-08-12 00:27:24 on dist-test-slave-c12x"
server_key: "0cca63f94aed1862318c4fadeaca5217"
server_key_iv: "44a816aa6efa9684019acdc30a6ccefa"
server_key_version: "encryptionkey@0"
I20260812 00:27:25.015883 871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:25.033131 871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:25.037309 871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:25.037621 871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:25.040688 871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:25.040830 871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:25.040956 871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:25.041047 871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:27:25 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494444, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:25.068285 710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.041123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:56233 (local address 127.29.190.190:32995)
0812 00:27:25.041325 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:25.041332 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:25.042776 (+ 1444us) server_negotiation.cc:407] Connection header received
0812 00:27:25.044923 (+ 2147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:25.044929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:25.045030 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:25.045180 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:25.047754 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.048936 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.052339 (+ 3403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.052757 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.052858 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.058555 (+ 5697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:25.058565 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:25.058573 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:25.058625 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:25.063229 (+ 4604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.064730 (+ 1501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.064740 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.064743 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.064955 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.065709 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.065715 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.065718 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.066199 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:25.066401 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:25.067568 (+ 1167us) server_negotiation.cc:299] Negotiation successful
0812 00:27:25.067846 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:27:25.069495 910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.041704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32995 (local address 127.29.190.130:56233)
0812 00:27:25.042586 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:25.042643 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:25.044634 (+ 1991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:25.045482 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:25.045492 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:25.046462 (+ 970us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:25.047557 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.047586 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.049135 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.049144 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.052169 (+ 3025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.052190 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.053020 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.053030 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.053384 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.054217 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:25.054259 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:25.058231 (+ 3972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:25.063570 (+ 5339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:25.063579 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:25.063596 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:25.064462 (+ 866us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:25.065113 (+ 651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:25.065120 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:25.065123 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:25.065543 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:25.066482 (+ 939us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:25.066493 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:25.067058 (+ 565us) client_negotiation.cc:769] Sending connection context
0812 00:27:25.067462 (+ 404us) client_negotiation.cc:240] Negotiation successful
0812 00:27:25.068143 (+ 681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":385,"threads_started":1}
I20260812 00:27:25.096033 710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.078033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:51353 (local address 127.29.190.190:32995)
0812 00:27:25.078264 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:25.078273 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:25.078822 (+ 549us) server_negotiation.cc:407] Connection header received
0812 00:27:25.079079 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:25.079089 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:25.079200 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:25.079328 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:25.081183 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.082551 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.085264 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.085877 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.086133 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.089001 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:25.089011 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:25.089017 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:25.089065 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:25.092417 (+ 3352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.093359 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.093365 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.093369 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.093604 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.094175 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.094179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.094181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.094613 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:25.094786 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:25.095481 (+ 695us) server_negotiation.cc:299] Negotiation successful
0812 00:27:25.095767 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 00:27:25.096539 986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.078043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32995 (local address 127.29.190.130:51353)
0812 00:27:25.078631 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:25.078679 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:25.078907 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:25.079396 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:25.079402 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:25.080327 (+ 925us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:25.080971 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.080995 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.082791 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.082796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.085066 (+ 2270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.085089 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.086203 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.086216 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.086470 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.087298 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:25.087323 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:25.088696 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:25.092568 (+ 3872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:25.092574 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:25.092578 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:25.093203 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:25.093756 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:25.093767 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:25.093772 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:25.094017 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:25.094776 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:25.094785 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:25.095089 (+ 304us) client_negotiation.cc:769] Sending connection context
0812 00:27:25.095291 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 00:27:25.095833 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":314,"threads_started":1}
I20260812 00:27:25.100553 871 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:39643
I20260812 00:27:25.100595 1059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:39643 every 8 connection(s)
I20260812 00:27:25.101969 871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:25.104230 1060 heartbeater.cc:347] Connected to a master server at 127.29.190.190:32995
I20260812 00:27:25.104478 1060 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:25.105172 1060 heartbeater.cc:511] Master 127.29.190.190:32995 requested a full tablet report, sending...
I20260812 00:27:25.106714 584 ts_manager.cc:194] Registered new tserver with Master: 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643)
I20260812 00:27:25.107241 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 871
I20260812 00:27:25.107446 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:25.108033 30458 external_mini_cluster.cc:1428] Setting key 26e049d360c732481ba66587c0e0783d
I20260812 00:27:25.107985 584 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:56233
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:27:25.158627 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32995
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:25.519704 1065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:25.520051 1065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:25.520239 1065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:25.528348 1065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:25.528513 1065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:25.528674 1065 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 00:27:25.528788 1065 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:27:25.528936 1065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:25.539201 1065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:32995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:25.540657 1065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:25.542018 1065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:25.556401 1078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:25.556411 1074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:25.556437 1071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:25.557243 1065 server_base.cc:1034] running on GCE node
I20260812 00:27:25.557857 1065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:25.559175 1065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:25.560408 1065 hybrid_clock.cc:648] HybridClock initialized: now 1786494445560332 us; error 100 us; skew 500 ppm
I20260812 00:27:25.560771 1065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:25.563304 865 heartbeater.cc:503] Master 127.29.190.190:32995 was elected leader, sending a full tablet report...
Aug 12 00:27:25 dist-test-slave-c12x krb5kdc[519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494445, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:25.564289 1065 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:27:25.565940 1065 webserver.cc:460] Webserver started at http://127.29.190.131:38553/ using document root <none> and password file <none>
I20260812 00:27:25.566674 1065 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:25.566808 1065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:25.567154 1065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:25.570288 1065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "e8bfdd1d890a48bda422f647e270e8fa"
format_stamp: "Formatted at 2026-08-12 00:27:25 on dist-test-slave-c12x"
server_key: "9241dd520eceab56f5a705e6330fa2b0"
server_key_iv: "a35f73088c63a87ed9923e8d43b5f63c"
server_key_version: "encryptionkey@0"
I20260812 00:27:25.571146 1065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "e8bfdd1d890a48bda422f647e270e8fa"
format_stamp: "Formatted at 2026-08-12 00:27:25 on dist-test-slave-c12x"
server_key: "9241dd520eceab56f5a705e6330fa2b0"
server_key_iv: "a35f73088c63a87ed9923e8d43b5f63c"
server_key_version: "encryptionkey@0"
I20260812 00:27:25.576633 1065 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:27:25.580430 1087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:25.581781 1065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:27:25.581946 1065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "e8bfdd1d890a48bda422f647e270e8fa"
format_stamp: "Formatted at 2026-08-12 00:27:25 on dist-test-slave-c12x"
server_key: "9241dd520eceab56f5a705e6330fa2b0"
server_key_iv: "a35f73088c63a87ed9923e8d43b5f63c"
server_key_version: "encryptionkey@0"
I20260812 00:27:25.582154 1065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:25.633445 1065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:25.637976 1065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:25.638299 1065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:25.641366 1065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:25.641505 1065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:25.641623 1065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:25.641714 1065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:27:25 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494445, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:25.667268 1104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.642167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:58287 (local address 127.29.190.190:32995)
0812 00:27:25.642732 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:25.642736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:25.644389 (+ 1653us) server_negotiation.cc:407] Connection header received
0812 00:27:25.646563 (+ 2174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:25.646569 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:25.646670 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:25.646799 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:25.649448 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.651207 (+ 1759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.653874 (+ 2667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.654531 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.654684 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.660089 (+ 5405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:25.660099 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:25.660106 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:25.660165 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:25.663848 (+ 3683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.664712 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.664717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.664719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.664852 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.665341 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.665351 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.665354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.665647 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:25.665822 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:25.666590 (+ 768us) server_negotiation.cc:299] Negotiation successful
0812 00:27:25.666848 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":350,"threads_started":1}
I20260812 00:27:25.668915 1106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.643190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32995 (local address 127.29.190.131:58287)
0812 00:27:25.644204 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:25.644254 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:25.646255 (+ 2001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:25.647107 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:25.647116 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:25.648078 (+ 962us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:25.649153 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.649186 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.651413 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.651417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.653690 (+ 2273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.653715 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.654804 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.654811 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.655172 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.656129 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:25.656176 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:25.659703 (+ 3527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:25.664037 (+ 4334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:25.664048 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:25.664067 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:25.664555 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:25.664978 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:25.664984 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:25.664988 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:25.665211 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:25.665787 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:25.665796 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:25.666194 (+ 398us) client_negotiation.cc:769] Sending connection context
0812 00:27:25.666480 (+ 286us) client_negotiation.cc:240] Negotiation successful
0812 00:27:25.667120 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"thread_start_us":449,"threads_started":1}
I20260812 00:27:25.692413 1104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.675761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:48599 (local address 127.29.190.190:32995)
0812 00:27:25.676011 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:25.676021 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:25.676767 (+ 746us) server_negotiation.cc:407] Connection header received
0812 00:27:25.676978 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:25.676988 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:25.677064 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:25.677173 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:25.678309 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.679334 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.681924 (+ 2590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.682516 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.682664 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.684688 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:25.684696 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:25.684704 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:25.684755 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:25.689049 (+ 4294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.690066 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.690074 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.690080 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.690270 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.690744 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.690750 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.690753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.691106 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:25.691277 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:25.691796 (+ 519us) server_negotiation.cc:299] Negotiation successful
0812 00:27:25.692036 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:27:25.692602 1178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.675656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32995 (local address 127.29.190.131:48599)
0812 00:27:25.676656 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:25.676677 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:25.676839 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:25.677204 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:25.677208 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:25.677680 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:25.678156 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.678169 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.679525 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.679532 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.681734 (+ 2202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.681757 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.682731 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.682741 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.682930 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.683711 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:25.683728 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:25.684477 (+ 749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:25.689257 (+ 4780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:25.689265 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:25.689271 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:25.689889 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:25.690418 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:25.690423 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:25.690426 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:25.690613 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:25.691238 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:25.691244 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:25.691496 (+ 252us) client_negotiation.cc:769] Sending connection context
0812 00:27:25.691685 (+ 189us) client_negotiation.cc:240] Negotiation successful
0812 00:27:25.692080 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"thread_start_us":647,"threads_started":1}
I20260812 00:27:25.703698 1065 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:33767
I20260812 00:27:25.703742 1255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:33767 every 8 connection(s)
I20260812 00:27:25.705163 1065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:25.707648 1256 heartbeater.cc:347] Connected to a master server at 127.29.190.190:32995
I20260812 00:27:25.707906 1256 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:25.708575 1256 heartbeater.cc:511] Master 127.29.190.190:32995 requested a full tablet report, sending...
I20260812 00:27:25.710168 584 ts_manager.cc:194] Registered new tserver with Master: e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767)
I20260812 00:27:25.711058 584 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:58287
I20260812 00:27:25.712363 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 1065
I20260812 00:27:25.712610 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:25.713086 30458 external_mini_cluster.cc:1428] Setting key b86bf77824e4817cdf8d2fcc1925889a
I20260812 00:27:25.716208 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:27:25 dist-test-slave-c12x krb5kdc[519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:27:25 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:25.768015 1104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.753953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37708 (local address 127.29.190.190:32995)
0812 00:27:25.754143 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:25.754148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:25.754492 (+ 344us) server_negotiation.cc:407] Connection header received
0812 00:27:25.754654 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:25.754658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:25.754727 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:25.754826 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:25.756337 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.757152 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.758410 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.758860 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.758976 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.762915 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:25.762921 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:25.762924 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:25.762962 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:25.765535 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.766192 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.766196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.766198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.766327 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:25.766673 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:25.766677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:25.766679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:25.766971 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:25.767194 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:25.767541 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 00:27:25.767736 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:27:25.772572 584 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:27:25.779832 584 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:25.804992 1281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.793484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39668 (local address 127.29.190.130:39643)
0812 00:27:25.796405 (+ 2921us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:25.796414 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:25.796442 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:27:25.796569 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:25.796580 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:25.796889 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:25.797141 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:25.797798 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.799412 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.802056 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.803694 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.803899 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.804097 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:25.804480 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 00:27:25.804655 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2757,"thread_start_us":2614,"threads_started":1}
I20260812 00:27:25.805245 1280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.793296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39643 (local address 127.0.0.1:39668)
0812 00:27:25.794670 (+ 1374us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:25.794736 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:25.794962 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:25.797133 (+ 2171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:25.797142 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:25.797174 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:25.797588 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.797606 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.799610 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.799615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.801807 (+ 2192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.801839 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.803920 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.803927 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.804186 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.804262 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 00:27:25.804401 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 00:27:25.804661 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1039,"mutex_wait_us":90,"thread_start_us":866,"threads_started":1}
I20260812 00:27:25.805331 1283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.795094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:33767 (local address 127.0.0.1:48066)
0812 00:27:25.796320 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:25.796339 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:25.796475 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:25.797718 (+ 1243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:25.797725 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:25.797753 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:25.798157 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.798169 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.800230 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.800236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.802347 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.802372 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.804185 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.804191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.804334 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.804374 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:27:25.804441 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 00:27:25.804648 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1098,"mutex_wait_us":2,"thread_start_us":1249,"threads_started":1}
I20260812 00:27:25.806303 1282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.793989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:46347 (local address 127.0.0.1:60512)
0812 00:27:25.795728 (+ 1739us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:25.795751 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:25.795883 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:25.798361 (+ 2478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:25.798366 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:25.798408 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:25.798859 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.798874 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.800999 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.801008 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.803199 (+ 2191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:25.803214 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.805068 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.805079 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:25.805429 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.805461 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 00:27:25.805540 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 00:27:25.805643 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1564,"thread_start_us":1351,"threads_started":1}
I20260812 00:27:25.806870 1285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.796169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48066 (local address 127.29.190.131:33767)
0812 00:27:25.797126 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:25.797133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:25.797163 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:27:25.797265 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:25.797275 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:25.797492 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:25.798360 (+ 868us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:25.798666 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.800078 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.802564 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.803949 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.805589 (+ 1640us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.805782 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:25.805869 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 00:27:25.806226 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":802,"thread_start_us":598,"threads_started":1}
I20260812 00:27:25.806995 1284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:25.795557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60512 (local address 127.29.190.129:46347)
0812 00:27:25.797808 (+ 2251us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:25.797813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:25.797835 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:27:25.797909 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:25.797914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:25.798133 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:25.799080 (+ 947us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:25.799300 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.800840 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.803381 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:25.804766 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:25.805933 (+ 1167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:25.806100 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:25.806529 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 00:27:25.806704 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2106,"thread_start_us":1982,"threads_started":1}
I20260812 00:27:25.809963 1161 tablet_service.cc:1467] Processing CreateTablet for tablet e9a8bded393c46698201de2ce3adfe54 (DEFAULT_TABLE table=test-table [id=f73c454d907a4f1bafcecc66452d2c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:25.809793 967 tablet_service.cc:1467] Processing CreateTablet for tablet e9a8bded393c46698201de2ce3adfe54 (DEFAULT_TABLE table=test-table [id=f73c454d907a4f1bafcecc66452d2c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:25.810491 771 tablet_service.cc:1467] Processing CreateTablet for tablet e9a8bded393c46698201de2ce3adfe54 (DEFAULT_TABLE table=test-table [id=f73c454d907a4f1bafcecc66452d2c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:25.811290 967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9a8bded393c46698201de2ce3adfe54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:25.811268 1161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9a8bded393c46698201de2ce3adfe54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:25.811762 771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9a8bded393c46698201de2ce3adfe54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:25.824229 1287 tablet_bootstrap.cc:492] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Bootstrap starting.
I20260812 00:27:25.826514 1289 tablet_bootstrap.cc:492] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Bootstrap starting.
I20260812 00:27:25.828327 1290 tablet_bootstrap.cc:492] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Bootstrap starting.
I20260812 00:27:25.830225 1289 tablet_bootstrap.cc:654] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:25.830225 1287 tablet_bootstrap.cc:654] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:25.831586 1290 tablet_bootstrap.cc:654] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:25.831660 1289 log.cc:824] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:25.831660 1287 log.cc:824] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:25.833019 1290 log.cc:824] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:25.835479 1289 tablet_bootstrap.cc:492] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: No bootstrap required, opened a new log
I20260812 00:27:25.835834 1289 ts_tablet_manager.cc:1397] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.006s
I20260812 00:27:25.836068 1290 tablet_bootstrap.cc:492] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: No bootstrap required, opened a new log
I20260812 00:27:25.836337 1290 ts_tablet_manager.cc:1397] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.006s
I20260812 00:27:25.837106 1287 tablet_bootstrap.cc:492] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: No bootstrap required, opened a new log
I20260812 00:27:25.837386 1287 ts_tablet_manager.cc:1397] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260812 00:27:25.843838 1290 raft_consensus.cc:348] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:25.844246 1290 raft_consensus.cc:374] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:25.844350 1290 raft_consensus.cc:729] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dcf04bbdcae45b1a39c05665c8f0134, State: Initialized, Role: FOLLOWER
I20260812 00:27:25.845055 1290 consensus_queue.cc:260] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:25.847541 1060 heartbeater.cc:503] Master 127.29.190.190:32995 was elected leader, sending a full tablet report...
I20260812 00:27:25.848248 1290 ts_tablet_manager.cc:1428] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260812 00:27:25.848237 1287 raft_consensus.cc:348] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:25.848711 1287 raft_consensus.cc:374] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:25.848842 1287 raft_consensus.cc:729] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bfdd1d890a48bda422f647e270e8fa, State: Initialized, Role: FOLLOWER
I20260812 00:27:25.847069 1289 raft_consensus.cc:348] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:25.849439 1289 raft_consensus.cc:374] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:25.849591 1289 raft_consensus.cc:729] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8f949882c14a1f95d283300fa1be87, State: Initialized, Role: FOLLOWER
I20260812 00:27:25.850421 1289 consensus_queue.cc:260] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:25.850450 1287 consensus_queue.cc:260] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:25.852252 1256 heartbeater.cc:503] Master 127.29.190.190:32995 was elected leader, sending a full tablet report...
I20260812 00:27:25.852546 1287 ts_tablet_manager.cc:1428] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260812 00:27:25.853428 1289 ts_tablet_manager.cc:1428] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Time spent starting tablet: real 0.017s user 0.006s sys 0.008s
W20260812 00:27:25.854045 1061 tablet.cc:2369] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:27:25.957070 1257 tablet.cc:2369] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:27:26.052858 866 tablet.cc:2369] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:26.106405 1296 raft_consensus.cc:482] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:26.106791 1296 raft_consensus.cc:504] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:26.108604 1296 leader_election.cc:288] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767), ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347)
I20260812 00:27:26.118007 1284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.109133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:33843 (local address 127.29.190.129:46347)
0812 00:27:26.109398 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.109408 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.110791 (+ 1383us) server_negotiation.cc:407] Connection header received
0812 00:27:26.110940 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.110945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.111024 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.111139 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:26.111923 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.112950 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.115474 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.116733 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.116893 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.116970 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.117617 (+ 647us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.117750 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:27:26.118002 1285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.109596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:43805 (local address 127.29.190.131:33767)
0812 00:27:26.109777 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.109781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.110430 (+ 649us) server_negotiation.cc:407] Connection header received
0812 00:27:26.110740 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.110746 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.110828 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.110931 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:26.111632 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.112719 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.115474 (+ 2755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.116722 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.116894 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.116970 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.117617 (+ 647us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.117750 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:27:26.118364 1299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.109070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:33767 (local address 127.29.190.130:43805)
0812 00:27:26.110301 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.110329 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.110564 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.110963 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.110967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.110989 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:26.111422 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.111480 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.112863 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.112866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.115278 (+ 2412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.115289 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.117084 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.117091 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.117343 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.117462 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.117579 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.117805 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1010,"mutex_wait_us":114,"thread_start_us":1265,"threads_started":1}
I20260812 00:27:26.118412 1301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.109082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:46347 (local address 127.29.190.130:33843)
0812 00:27:26.110674 (+ 1592us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.110693 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.110811 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.111173 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.111177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.111210 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:26.111721 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.111733 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.113091 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.113096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.115274 (+ 2178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.115289 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.117063 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.117072 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.117335 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.117458 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.117579 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.117805 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1450,"mutex_wait_us":115,"thread_start_us":509,"threads_started":1}
I20260812 00:27:26.119570 1195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9a8bded393c46698201de2ce3adfe54" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bfdd1d890a48bda422f647e270e8fa" is_pre_election: true
I20260812 00:27:26.119567 795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9a8bded393c46698201de2ce3adfe54" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8f949882c14a1f95d283300fa1be87" is_pre_election: true
I20260812 00:27:26.120132 1195 raft_consensus.cc:2454] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 0.
I20260812 00:27:26.120115 795 raft_consensus.cc:2454] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 0.
I20260812 00:27:26.120875 902 leader_election.cc:302] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, e8bfdd1d890a48bda422f647e270e8fa; no voters:
I20260812 00:27:26.121379 1296 raft_consensus.cc:2781] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:26.121544 1296 raft_consensus.cc:482] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:26.121677 1296 raft_consensus.cc:3037] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.123989 1296 raft_consensus.cc:504] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:26.124639 1296 leader_election.cc:288] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 election: Requested vote from peers e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767), ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347)
I20260812 00:27:26.125170 1195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9a8bded393c46698201de2ce3adfe54" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bfdd1d890a48bda422f647e270e8fa"
I20260812 00:27:26.125200 795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9a8bded393c46698201de2ce3adfe54" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8f949882c14a1f95d283300fa1be87"
I20260812 00:27:26.125388 1195 raft_consensus.cc:3037] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.125419 795 raft_consensus.cc:3037] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.127633 1195 raft_consensus.cc:2454] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 1.
I20260812 00:27:26.127714 795 raft_consensus.cc:2454] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 1.
I20260812 00:27:26.128114 902 leader_election.cc:302] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, e8bfdd1d890a48bda422f647e270e8fa; no voters:
I20260812 00:27:26.128417 1296 raft_consensus.cc:2781] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:26.128907 1296 raft_consensus.cc:686] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 LEADER]: Becoming Leader. State: Replica: 2dcf04bbdcae45b1a39c05665c8f0134, State: Running, Role: LEADER
I20260812 00:27:26.129402 1296 consensus_queue.cc:237] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } }
I20260812 00:27:26.133971 585 catalog_manager.cc:5495] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } health_report { overall_health: UNKNOWN } } }
Aug 12 00:27:26 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494443, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:26.200058 1311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.186333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32995 (local address 127.0.0.1:37720)
0812 00:27:26.186918 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.186934 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.187075 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.187569 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.187573 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.188448 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:26.188714 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.188724 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.189792 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.189796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.190736 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.190747 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.191576 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.191581 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.191689 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.192319 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:26.192341 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:26.194671 (+ 2330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:26.197680 (+ 3009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:26.197691 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:26.197697 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:26.198161 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:26.198499 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:26.198503 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:26.198505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:26.198625 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:26.199102 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:26.199107 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:26.199268 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.199411 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.199680 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":288,"threads_started":1}
I20260812 00:27:26.200055 1104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.186270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37720 (local address 127.29.190.190:32995)
0812 00:27:26.186463 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.186477 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.187047 (+ 570us) server_negotiation.cc:407] Connection header received
0812 00:27:26.187189 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.187229 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.187322 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.187528 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:26.188879 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.189658 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.190879 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.191343 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.191522 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.194839 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:26.194845 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:26.194848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:26.194876 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:26.197546 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:26.198268 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:26.198273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:26.198275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:26.198384 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:26.198717 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:26.198721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:26.198723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:26.198990 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:26.199099 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.199548 (+ 449us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.199792 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":62}
I20260812 00:27:26.205585 585 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:37720:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:27:26.206857 585 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:26.214527 771 tablet_service.cc:1467] Processing CreateTablet for tablet 285d72ee64db4b13ab87cb4944819fb1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a6cca25cf0b34cac82cac9f8110670a4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:27:26.214601 967 tablet_service.cc:1467] Processing CreateTablet for tablet 285d72ee64db4b13ab87cb4944819fb1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a6cca25cf0b34cac82cac9f8110670a4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:27:26.215610 967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 285d72ee64db4b13ab87cb4944819fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:26.215601 771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 285d72ee64db4b13ab87cb4944819fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:26.215528 1161 tablet_service.cc:1467] Processing CreateTablet for tablet 285d72ee64db4b13ab87cb4944819fb1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a6cca25cf0b34cac82cac9f8110670a4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:27:26.216351 1161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 285d72ee64db4b13ab87cb4944819fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:26.222344 1287 tablet_bootstrap.cc:492] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: Bootstrap starting.
I20260812 00:27:26.223227 1289 tablet_bootstrap.cc:492] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: Bootstrap starting.
I20260812 00:27:26.223654 1290 tablet_bootstrap.cc:492] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: Bootstrap starting.
I20260812 00:27:26.224330 1287 tablet_bootstrap.cc:654] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:26.224992 1289 tablet_bootstrap.cc:654] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:26.225585 1290 tablet_bootstrap.cc:654] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:26.226799 1287 tablet_bootstrap.cc:492] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: No bootstrap required, opened a new log
I20260812 00:27:26.227051 1287 ts_tablet_manager.cc:1397] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 00:27:26.228143 1290 tablet_bootstrap.cc:492] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: No bootstrap required, opened a new log
I20260812 00:27:26.228003 1287 raft_consensus.cc:348] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.228286 1290 ts_tablet_manager.cc:1397] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.002s
I20260812 00:27:26.228271 1287 raft_consensus.cc:374] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:26.228389 1287 raft_consensus.cc:729] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bfdd1d890a48bda422f647e270e8fa, State: Initialized, Role: FOLLOWER
I20260812 00:27:26.228634 1289 tablet_bootstrap.cc:492] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: No bootstrap required, opened a new log
I20260812 00:27:26.228773 1289 ts_tablet_manager.cc:1397] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 00:27:26.228704 1287 consensus_queue.cc:260] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.229157 1290 raft_consensus.cc:348] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.229431 1290 raft_consensus.cc:374] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:26.229537 1290 raft_consensus.cc:729] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dcf04bbdcae45b1a39c05665c8f0134, State: Initialized, Role: FOLLOWER
I20260812 00:27:26.229660 1289 raft_consensus.cc:348] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.229919 1289 raft_consensus.cc:374] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:26.229799 1290 consensus_queue.cc:260] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.229723 1298 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.230020 1289 raft_consensus.cc:729] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8f949882c14a1f95d283300fa1be87, State: Initialized, Role: FOLLOWER
I20260812 00:27:26.230135 1298 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:26.230244 1289 consensus_queue.cc:260] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.230435 1290 ts_tablet_manager.cc:1428] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:27:26.230304 1296 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.230634 1296 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:26.230743 1297 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.231161 1297 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:26.231408 1287 ts_tablet_manager.cc:1428] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:27:26.231668 1289 ts_tablet_manager.cc:1428] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 00:27:26.265021 1296 raft_consensus.cc:482] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:26.265270 1296 raft_consensus.cc:504] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.266054 1296 leader_election.cc:288] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347), e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767)
I20260812 00:27:26.266779 1195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285d72ee64db4b13ab87cb4944819fb1" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bfdd1d890a48bda422f647e270e8fa" is_pre_election: true
I20260812 00:27:26.266779 795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285d72ee64db4b13ab87cb4944819fb1" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8f949882c14a1f95d283300fa1be87" is_pre_election: true
I20260812 00:27:26.267127 795 raft_consensus.cc:2454] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 0.
I20260812 00:27:26.267114 1195 raft_consensus.cc:2454] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 0.
I20260812 00:27:26.267669 902 leader_election.cc:302] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, e8bfdd1d890a48bda422f647e270e8fa; no voters:
I20260812 00:27:26.268038 1296 raft_consensus.cc:2781] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:26.268147 1296 raft_consensus.cc:482] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:26.268271 1296 raft_consensus.cc:3037] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.270709 1296 raft_consensus.cc:504] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.271898 1296 leader_election.cc:288] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 election: Requested vote from peers ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347), e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767)
I20260812 00:27:26.272066 1195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285d72ee64db4b13ab87cb4944819fb1" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bfdd1d890a48bda422f647e270e8fa"
I20260812 00:27:26.272066 795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285d72ee64db4b13ab87cb4944819fb1" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8f949882c14a1f95d283300fa1be87"
I20260812 00:27:26.272349 795 raft_consensus.cc:3037] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.272351 1195 raft_consensus.cc:3037] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.275803 1195 raft_consensus.cc:2454] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 1.
I20260812 00:27:26.275803 795 raft_consensus.cc:2454] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 1.
I20260812 00:27:26.276368 902 leader_election.cc:302] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, ac8f949882c14a1f95d283300fa1be87, e8bfdd1d890a48bda422f647e270e8fa; no voters:
I20260812 00:27:26.276813 1296 raft_consensus.cc:2781] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:26.277053 1296 raft_consensus.cc:686] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 LEADER]: Becoming Leader. State: Replica: 2dcf04bbdcae45b1a39c05665c8f0134, State: Running, Role: LEADER
I20260812 00:27:26.277384 1296 consensus_queue.cc:237] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.279256 1302 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: TxnStatusTablet state changed. Reason: New leader 2dcf04bbdcae45b1a39c05665c8f0134. Latest consensus state: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.279685 1302 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:27:26.280506 1322 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:27:26.280815 1322 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:27:26.281213 583 catalog_manager.cc:5495] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } health_report { overall_health: UNKNOWN } } }
I20260812 00:27:26.317376 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.310347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58078 (local address 127.29.190.130:39643)
0812 00:27:26.311037 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.311042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.311061 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:27:26.311162 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.311166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.311250 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.311399 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:26.311895 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.312866 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.314874 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.315348 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.315532 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.316075 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.316680 (+ 605us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.316803 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.317018 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.317093 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":395,"threads_started":1}
I20260812 00:27:26.317431 1311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.310229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39643 (local address 127.0.0.1:58078)
0812 00:27:26.310512 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.310535 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.310690 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.311493 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.311498 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.311513 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:26.311717 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.311728 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.313014 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.313020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.314707 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.314725 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.315551 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.315558 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.315775 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.315856 (+ 81us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.316802 (+ 946us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.316832 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.316933 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.317101 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 00:27:26.327013 1195 raft_consensus.cc:1261] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Refusing update from remote peer 2dcf04bbdcae45b1a39c05665c8f0134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:26.327255 795 raft_consensus.cc:1261] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Refusing update from remote peer 2dcf04bbdcae45b1a39c05665c8f0134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:26.328231 1302 consensus_queue.cc:1035] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:26.328634 1296 consensus_queue.cc:1035] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:26.341945 1298 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: TxnStatusTablet state changed. Reason: New leader 2dcf04bbdcae45b1a39c05665c8f0134. Latest consensus state: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.342278 1298 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:26.347173 1328 mvcc.cc:205] Tried to move back new op lower bound from 7317481252144447488 to 7317481251955343360. Current Snapshot: MvccSnapshot[applied={T|T < 7317481252144447488}]
I20260812 00:27:26.349355 1302 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.349670 1302 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:27:26.351006 1297 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: TxnStatusTablet state changed. Reason: New leader 2dcf04bbdcae45b1a39c05665c8f0134. Latest consensus state: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.351305 1297 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:26.359633 1298 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.359954 1298 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P e8bfdd1d890a48bda422f647e270e8fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:26.364425 1296 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.364821 1296 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P 2dcf04bbdcae45b1a39c05665c8f0134: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:27:26.380149 1297 tablet_replica.cc:439] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } } }
I20260812 00:27:26.380512 1297 tablet_replica.cc:442] T 285d72ee64db4b13ab87cb4944819fb1 P ac8f949882c14a1f95d283300fa1be87: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:27:26.383229 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.371538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58090 (local address 127.29.190.130:39643)
0812 00:27:26.371712 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.371721 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.371763 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:27:26.371848 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.371855 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.371958 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.372067 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:26.375742 (+ 3675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.377467 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.380442 (+ 2975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.381138 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.381254 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.382101 (+ 847us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.382265 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.382343 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.382713 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.382817 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:27:26.414376 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.403370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:56909 (local address 127.29.190.130:39643)
0812 00:27:26.403662 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.403673 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.404155 (+ 482us) server_negotiation.cc:407] Connection header received
0812 00:27:26.404406 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.404410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.404524 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.404639 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:26.405526 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.406970 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.411526 (+ 4556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.412242 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.412376 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.413243 (+ 867us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.413484 (+ 241us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.413575 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.413869 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.413957 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 00:27:26.415228 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.403187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39643 (local address 127.29.190.130:56909)
0812 00:27:26.404033 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.404054 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.404234 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.404870 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.404875 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.404888 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:26.405299 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.405314 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.407127 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.407138 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.409055 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.409074 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.412524 (+ 3450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.412536 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.412817 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.412940 (+ 123us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.413663 (+ 723us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.413676 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.413825 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.414040 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":469,"threads_started":1}
I20260812 00:27:26.427501 1195 raft_consensus.cc:1261] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Refusing update from remote peer 2dcf04bbdcae45b1a39c05665c8f0134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:26.427527 795 raft_consensus.cc:1261] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Refusing update from remote peer 2dcf04bbdcae45b1a39c05665c8f0134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:26.428371 1335 consensus_queue.cc:1035] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:26.429388 1302 consensus_queue.cc:1035] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:26.501646 583 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:26.501905 583 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:26.506008 583 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: Sending DeleteTablet for 3 replicas of tablet e9a8bded393c46698201de2ce3adfe54
I20260812 00:27:26.507326 966 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a8bded393c46698201de2ce3adfe54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:26 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:39668
I20260812 00:27:26.507378 771 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a8bded393c46698201de2ce3adfe54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:26 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:60512
I20260812 00:27:26.507805 1161 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a8bded393c46698201de2ce3adfe54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:26 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:48066
I20260812 00:27:26.517267 583 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:27:26.518361 583 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:26.520406 1358 tablet_replica.cc:330] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: stopping tablet replica
I20260812 00:27:26.520502 1357 tablet_replica.cc:330] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: stopping tablet replica
I20260812 00:27:26.520961 1357 raft_consensus.cc:2229] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:26.521309 1360 tablet_replica.cc:330] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: stopping tablet replica
I20260812 00:27:26.521440 1357 raft_consensus.cc:2258] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:26.521725 1360 raft_consensus.cc:2229] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:26.522078 1360 raft_consensus.cc:2258] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:26.522676 1358 raft_consensus.cc:2229] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:27:26.524039 1357 ts_tablet_manager.cc:1905] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:26.524674 1360 ts_tablet_manager.cc:1905] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:26.523396 1358 raft_consensus.cc:2258] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:26.529417 1358 ts_tablet_manager.cc:1905] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:26.530049 771 tablet_service.cc:1467] Processing CreateTablet for tablet cf27a242fddd4f3587722f43badc6738 (DEFAULT_TABLE table=test-table [id=6feb43cd5910453dbd74ff65848f496c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:26.530622 771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf27a242fddd4f3587722f43badc6738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:26.532153 1357 ts_tablet_manager.cc:1918] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:26.532325 1357 log.cc:1196] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/e9a8bded393c46698201de2ce3adfe54
I20260812 00:27:26.532958 1357 ts_tablet_manager.cc:1939] T e9a8bded393c46698201de2ce3adfe54 P ac8f949882c14a1f95d283300fa1be87: Deleting consensus metadata
I20260812 00:27:26.534915 565 catalog_manager.cc:4841] TS ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347): tablet e9a8bded393c46698201de2ce3adfe54 (table test-table [id=f73c454d907a4f1bafcecc66452d2c43]) successfully deleted
I20260812 00:27:26.536140 1161 tablet_service.cc:1467] Processing CreateTablet for tablet cf27a242fddd4f3587722f43badc6738 (DEFAULT_TABLE table=test-table [id=6feb43cd5910453dbd74ff65848f496c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:26.536546 1360 ts_tablet_manager.cc:1918] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:26.536742 1360 log.cc:1196] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/e9a8bded393c46698201de2ce3adfe54
I20260812 00:27:26.537246 1360 ts_tablet_manager.cc:1939] T e9a8bded393c46698201de2ce3adfe54 P e8bfdd1d890a48bda422f647e270e8fa: Deleting consensus metadata
I20260812 00:27:26.537449 1161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf27a242fddd4f3587722f43badc6738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:26.539175 566 catalog_manager.cc:4841] TS e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767): tablet e9a8bded393c46698201de2ce3adfe54 (table test-table [id=f73c454d907a4f1bafcecc66452d2c43]) successfully deleted
I20260812 00:27:26.537170 966 tablet_service.cc:1467] Processing CreateTablet for tablet cf27a242fddd4f3587722f43badc6738 (DEFAULT_TABLE table=test-table [id=6feb43cd5910453dbd74ff65848f496c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:26.539878 966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf27a242fddd4f3587722f43badc6738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:26.540954 1358 ts_tablet_manager.cc:1918] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:26.541165 1358 log.cc:1196] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/e9a8bded393c46698201de2ce3adfe54
I20260812 00:27:26.541673 1358 ts_tablet_manager.cc:1939] T e9a8bded393c46698201de2ce3adfe54 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting consensus metadata
I20260812 00:27:26.543129 566 catalog_manager.cc:4841] TS 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643): tablet e9a8bded393c46698201de2ce3adfe54 (table test-table [id=f73c454d907a4f1bafcecc66452d2c43]) successfully deleted
I20260812 00:27:26.545738 1289 tablet_bootstrap.cc:492] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: Bootstrap starting.
I20260812 00:27:26.547482 1290 tablet_bootstrap.cc:492] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: Bootstrap starting.
I20260812 00:27:26.547773 1289 tablet_bootstrap.cc:654] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:26.550530 1287 tablet_bootstrap.cc:492] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: Bootstrap starting.
I20260812 00:27:26.552413 1290 tablet_bootstrap.cc:654] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:26.552561 1287 tablet_bootstrap.cc:654] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:26.561177 1289 tablet_bootstrap.cc:492] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: No bootstrap required, opened a new log
I20260812 00:27:26.561466 1289 ts_tablet_manager.cc:1397] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260812 00:27:26.562649 1289 raft_consensus.cc:348] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.563052 1289 raft_consensus.cc:374] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:26.563170 1289 raft_consensus.cc:729] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8f949882c14a1f95d283300fa1be87, State: Initialized, Role: FOLLOWER
I20260812 00:27:26.564577 1289 consensus_queue.cc:260] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.567548 1287 tablet_bootstrap.cc:492] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: No bootstrap required, opened a new log
I20260812 00:27:26.567766 1287 ts_tablet_manager.cc:1397] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.013s
I20260812 00:27:26.568769 1289 ts_tablet_manager.cc:1428] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20260812 00:27:26.568804 1287 raft_consensus.cc:348] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.569134 1287 raft_consensus.cc:374] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:26.569285 1287 raft_consensus.cc:729] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bfdd1d890a48bda422f647e270e8fa, State: Initialized, Role: FOLLOWER
I20260812 00:27:26.569738 1287 consensus_queue.cc:260] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.573947 1287 ts_tablet_manager.cc:1428] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260812 00:27:26.574203 1290 tablet_bootstrap.cc:492] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: No bootstrap required, opened a new log
I20260812 00:27:26.574431 1290 ts_tablet_manager.cc:1397] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.005s
I20260812 00:27:26.576943 1290 raft_consensus.cc:348] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.577227 1290 raft_consensus.cc:374] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:26.577365 1290 raft_consensus.cc:729] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dcf04bbdcae45b1a39c05665c8f0134, State: Initialized, Role: FOLLOWER
I20260812 00:27:26.577842 1290 consensus_queue.cc:260] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.579171 1290 ts_tablet_manager.cc:1428] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260812 00:27:26.689536 1297 raft_consensus.cc:482] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:26.689851 1297 raft_consensus.cc:504] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.691916 1297 leader_election.cc:288] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643), e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767)
I20260812 00:27:26.703908 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.692358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:56617 (local address 127.29.190.130:39643)
0812 00:27:26.692609 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.692616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.693114 (+ 498us) server_negotiation.cc:407] Connection header received
0812 00:27:26.693401 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.693412 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.693547 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.693650 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:26.694740 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.696395 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.700239 (+ 3844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.702399 (+ 2160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.702633 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.702736 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.703382 (+ 646us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.703575 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:27:26.705058 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.692351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39643 (local address 127.29.190.129:56617)
0812 00:27:26.692977 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.693001 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.693168 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.693955 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.693963 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.694008 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:26.694457 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.694474 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.696692 (+ 2218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.696702 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.699929 (+ 3227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.699955 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.702936 (+ 2981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.702943 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.703149 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.703187 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.704481 (+ 1294us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.704657 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":357,"threads_started":1}
I20260812 00:27:26.711796 1000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf27a242fddd4f3587722f43badc6738" candidate_uuid: "ac8f949882c14a1f95d283300fa1be87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" is_pre_election: true
I20260812 00:27:26.712357 1000 raft_consensus.cc:2454] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8f949882c14a1f95d283300fa1be87 in term 0.
I20260812 00:27:26.713220 700 leader_election.cc:302] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, ac8f949882c14a1f95d283300fa1be87; no voters:
I20260812 00:27:26.713757 1297 raft_consensus.cc:2781] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:26.713907 1297 raft_consensus.cc:482] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:26.714039 1297 raft_consensus.cc:3037] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.717760 1297 raft_consensus.cc:504] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.718532 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.693209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:33767 (local address 127.29.190.129:48311)
0812 00:27:26.705568 (+ 12359us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.705591 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.705723 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.710848 (+ 5125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.710854 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.710890 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:26.711120 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.711133 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.713132 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.713138 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.715406 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.715462 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.717513 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.717522 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.717793 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.717838 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.717924 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.718108 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12231,"thread_start_us":17412,"threads_started":1}
I20260812 00:27:26.718705 1297 leader_election.cc:288] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [CANDIDATE]: Term 1 election: Requested vote from peers 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643), e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767)
I20260812 00:27:26.719652 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.693400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:48311 (local address 127.29.190.131:33767)
0812 00:27:26.710450 (+ 17050us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.710458 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.710483 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:27:26.710560 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.710566 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.710653 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.711279 (+ 626us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:26.711566 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.712931 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.715718 (+ 2787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.717249 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.718898 (+ 1649us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.718985 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.719051 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.719222 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16881,"thread_start_us":16688,"threads_started":1}
I20260812 00:27:26.719722 1000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf27a242fddd4f3587722f43badc6738" candidate_uuid: "ac8f949882c14a1f95d283300fa1be87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dcf04bbdcae45b1a39c05665c8f0134"
I20260812 00:27:26.720011 1000 raft_consensus.cc:3037] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.721015 1194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf27a242fddd4f3587722f43badc6738" candidate_uuid: "ac8f949882c14a1f95d283300fa1be87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bfdd1d890a48bda422f647e270e8fa"
I20260812 00:27:26.721321 1194 raft_consensus.cc:3037] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:26.724134 1000 raft_consensus.cc:2454] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8f949882c14a1f95d283300fa1be87 in term 1.
I20260812 00:27:26.724653 1195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf27a242fddd4f3587722f43badc6738" candidate_uuid: "ac8f949882c14a1f95d283300fa1be87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bfdd1d890a48bda422f647e270e8fa" is_pre_election: true
I20260812 00:27:26.725097 1194 raft_consensus.cc:2454] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8f949882c14a1f95d283300fa1be87 in term 1.
I20260812 00:27:26.726013 700 leader_election.cc:302] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, ac8f949882c14a1f95d283300fa1be87; no voters:
I20260812 00:27:26.726406 1297 raft_consensus.cc:2781] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:26.727095 1297 raft_consensus.cc:686] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 1 LEADER]: Becoming Leader. State: Replica: ac8f949882c14a1f95d283300fa1be87, State: Running, Role: LEADER
I20260812 00:27:26.727649 1297 consensus_queue.cc:237] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:26.732793 583 catalog_manager.cc:5495] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac8f949882c14a1f95d283300fa1be87 (127.29.190.129). New cstate: current_term: 1 leader_uuid: "ac8f949882c14a1f95d283300fa1be87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } health_report { overall_health: UNKNOWN } } }
I20260812 00:27:26.791167 1372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.783528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54176 (local address 127.29.190.129:46347)
0812 00:27:26.784405 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.784410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.784434 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:27:26.784818 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.784827 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.784963 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.785166 (+ 203us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:26.785746 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.786889 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.788501 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.788990 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.789164 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.789738 (+ 574us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.790387 (+ 649us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.790576 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.790667 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.790762 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":1202,"threads_started":1}
I20260812 00:27:26.811239 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.804090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51855 (local address 127.29.190.130:39643)
0812 00:27:26.804301 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.804308 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.805010 (+ 702us) server_negotiation.cc:407] Connection header received
0812 00:27:26.805153 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.805160 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.805252 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.805369 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:26.805985 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.807095 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.808805 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.809502 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.809639 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.810349 (+ 710us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.810529 (+ 180us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.810645 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.810830 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.810925 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:27:26.811388 1376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.804037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39643 (local address 127.29.190.129:51855)
0812 00:27:26.804885 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.804902 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.805037 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.805465 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.805469 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.805482 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:26.805792 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.805800 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.807252 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.807257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.808631 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.808648 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.809740 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.809746 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.809912 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.810130 (+ 218us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.810690 (+ 560us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.810702 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.810785 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.811015 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":443,"threads_started":1}
I20260812 00:27:26.821781 1194 raft_consensus.cc:1261] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Refusing update from remote peer ac8f949882c14a1f95d283300fa1be87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:26.822233 1000 raft_consensus.cc:1261] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Refusing update from remote peer ac8f949882c14a1f95d283300fa1be87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:26.822479 1370 consensus_queue.cc:1035] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:26.823016 1297 consensus_queue.cc:1035] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:26.830442 1330 mvcc.cc:205] Tried to move back new op lower bound from 7317481254175240192 to 7317481253801959424. Current Snapshot: MvccSnapshot[applied={T|T < 7317481254175240192}]
I20260812 00:27:26.832545 1329 mvcc.cc:205] Tried to move back new op lower bound from 7317481254175240192 to 7317481253801959424. Current Snapshot: MvccSnapshot[applied={T|T < 7317481254175240192}]
I20260812 00:27:26.858683 1372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.851490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:52389 (local address 127.29.190.129:46347)
0812 00:27:26.851901 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:26.851906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:26.851925 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:27:26.852182 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:26.852187 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:26.852275 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:26.852368 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:26.852972 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.854102 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.856139 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.856836 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.856970 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.857738 (+ 768us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.857894 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.858019 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:26.858254 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 00:27:26.858352 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303}
I20260812 00:27:26.858872 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:26.851596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:46347 (local address 127.29.190.130:52389)
0812 00:27:26.851836 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:26.851857 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:26.851985 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:26.852553 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:26.852559 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:26.852571 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:26.852791 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.852802 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.854225 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.854230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.855968 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:26.855986 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:26.857116 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:26.857123 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:26.857344 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:26.857408 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:26.858083 (+ 675us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:26.858097 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:27:26.858211 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:27:26.858392 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 00:27:26.860810 1330 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:27:28.475013 585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:28.475306 585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:28.480396 585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: Sending DeleteTablet for 3 replicas of tablet cf27a242fddd4f3587722f43badc6738
I20260812 00:27:28.481457 771 tablet_service.cc:1514] Processing DeleteTablet for tablet cf27a242fddd4f3587722f43badc6738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:28 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:60512
I20260812 00:27:28.481585 1161 tablet_service.cc:1514] Processing DeleteTablet for tablet cf27a242fddd4f3587722f43badc6738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:28 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:48066
I20260812 00:27:28.481560 966 tablet_service.cc:1514] Processing DeleteTablet for tablet cf27a242fddd4f3587722f43badc6738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:28 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:39668
I20260812 00:27:28.494320 1417 tablet_replica.cc:330] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: stopping tablet replica
I20260812 00:27:28.495097 1420 tablet_replica.cc:330] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: stopping tablet replica
I20260812 00:27:28.495653 1420 raft_consensus.cc:2229] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:28.496181 1417 raft_consensus.cc:2229] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:27:28.496579 1420 raft_consensus.cc:2258] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:28.496608 1419 tablet_replica.cc:330] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: stopping tablet replica
I20260812 00:27:28.496881 1419 raft_consensus.cc:2229] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:28.497255 1419 raft_consensus.cc:2258] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:28.497514 1417 raft_consensus.cc:2258] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:28.498364 1420 ts_tablet_manager.cc:1905] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:28.498576 1419 ts_tablet_manager.cc:1905] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:28.498752 1417 ts_tablet_manager.cc:1905] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:28.506500 1419 ts_tablet_manager.cc:1918] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:27:28.506559 1417 ts_tablet_manager.cc:1918] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:27:28.506716 1417 log.cc:1196] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/cf27a242fddd4f3587722f43badc6738
I20260812 00:27:28.506822 1419 log.cc:1196] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/cf27a242fddd4f3587722f43badc6738
I20260812 00:27:28.507414 1419 ts_tablet_manager.cc:1939] T cf27a242fddd4f3587722f43badc6738 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting consensus metadata
I20260812 00:27:28.507453 1417 ts_tablet_manager.cc:1939] T cf27a242fddd4f3587722f43badc6738 P ac8f949882c14a1f95d283300fa1be87: Deleting consensus metadata
I20260812 00:27:28.507467 1420 ts_tablet_manager.cc:1918] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:27:28.507730 1420 log.cc:1196] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/cf27a242fddd4f3587722f43badc6738
I20260812 00:27:28.508304 1420 ts_tablet_manager.cc:1939] T cf27a242fddd4f3587722f43badc6738 P e8bfdd1d890a48bda422f647e270e8fa: Deleting consensus metadata
I20260812 00:27:28.508841 565 catalog_manager.cc:4841] TS ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347): tablet cf27a242fddd4f3587722f43badc6738 (table test-table [id=6feb43cd5910453dbd74ff65848f496c]) successfully deleted
I20260812 00:27:28.508844 566 catalog_manager.cc:4841] TS 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643): tablet cf27a242fddd4f3587722f43badc6738 (table test-table [id=6feb43cd5910453dbd74ff65848f496c]) successfully deleted
I20260812 00:27:28.509572 566 catalog_manager.cc:4841] TS e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767): tablet cf27a242fddd4f3587722f43badc6738 (table test-table [id=6feb43cd5910453dbd74ff65848f496c]) successfully deleted
Aug 12 00:27:28 dist-test-slave-c12x krb5kdc[519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:27:28 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:28.553943 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:28.533821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56290 (local address 127.29.190.190:32995)
0812 00:27:28.534472 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:28.534477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:28.534502 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:27:28.534632 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:28.534636 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:28.534702 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:28.534801 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:28.536203 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:28.537003 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:28.538256 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:28.538708 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:28.538816 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:28.547261 (+ 8445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:28.547268 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:28.547272 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:28.547360 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:28.550771 (+ 3411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:28.551597 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:28.551604 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:28.551608 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:28.551763 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:28.552191 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:28.552203 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:28.552205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:28.552639 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:28.552943 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:28.553308 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 00:27:28.553563 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":339,"threads_started":1}
I20260812 00:27:28.558336 585 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:27:28.558996 585 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:28.567152 771 tablet_service.cc:1467] Processing CreateTablet for tablet 073b06f2b9864a29b58ec26bef549378 (DEFAULT_TABLE table=test-table [id=9ce4a799b5864761b3aaa60104118708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:28.567220 966 tablet_service.cc:1467] Processing CreateTablet for tablet 073b06f2b9864a29b58ec26bef549378 (DEFAULT_TABLE table=test-table [id=9ce4a799b5864761b3aaa60104118708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:28.567469 1161 tablet_service.cc:1467] Processing CreateTablet for tablet 073b06f2b9864a29b58ec26bef549378 (DEFAULT_TABLE table=test-table [id=9ce4a799b5864761b3aaa60104118708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:28.567692 966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073b06f2b9864a29b58ec26bef549378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:28.567699 771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073b06f2b9864a29b58ec26bef549378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:28.567929 1161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073b06f2b9864a29b58ec26bef549378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:28.574730 1436 tablet_bootstrap.cc:492] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: Bootstrap starting.
I20260812 00:27:28.575641 1437 tablet_bootstrap.cc:492] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: Bootstrap starting.
I20260812 00:27:28.576416 1438 tablet_bootstrap.cc:492] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: Bootstrap starting.
I20260812 00:27:28.576968 1436 tablet_bootstrap.cc:654] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:28.577764 1437 tablet_bootstrap.cc:654] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:28.578292 1438 tablet_bootstrap.cc:654] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:28.580920 1437 tablet_bootstrap.cc:492] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: No bootstrap required, opened a new log
I20260812 00:27:28.580911 1436 tablet_bootstrap.cc:492] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: No bootstrap required, opened a new log
I20260812 00:27:28.581086 1436 ts_tablet_manager.cc:1397] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260812 00:27:28.581091 1437 ts_tablet_manager.cc:1397] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260812 00:27:28.581655 1438 tablet_bootstrap.cc:492] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: No bootstrap required, opened a new log
I20260812 00:27:28.581882 1438 ts_tablet_manager.cc:1397] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260812 00:27:28.582031 1436 raft_consensus.cc:348] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.582075 1437 raft_consensus.cc:348] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.582345 1437 raft_consensus.cc:374] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:28.582357 1436 raft_consensus.cc:374] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:28.582460 1436 raft_consensus.cc:729] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bfdd1d890a48bda422f647e270e8fa, State: Initialized, Role: FOLLOWER
I20260812 00:27:28.582465 1437 raft_consensus.cc:729] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dcf04bbdcae45b1a39c05665c8f0134, State: Initialized, Role: FOLLOWER
I20260812 00:27:28.582707 1436 consensus_queue.cc:260] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.582751 1437 consensus_queue.cc:260] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.582862 1438 raft_consensus.cc:348] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.583127 1438 raft_consensus.cc:374] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:28.583247 1438 raft_consensus.cc:729] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8f949882c14a1f95d283300fa1be87, State: Initialized, Role: FOLLOWER
I20260812 00:27:28.583585 1438 consensus_queue.cc:260] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.584513 1438 ts_tablet_manager.cc:1428] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 00:27:28.585328 1436 ts_tablet_manager.cc:1428] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: Time spent starting tablet: real 0.004s user 0.004s sys 0.001s
I20260812 00:27:28.586144 1437 ts_tablet_manager.cc:1428] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260812 00:27:28.729972 1390 raft_consensus.cc:482] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:28.730305 1390 raft_consensus.cc:504] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.731362 1390 leader_election.cc:288] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347), e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767)
I20260812 00:27:28.732046 795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "073b06f2b9864a29b58ec26bef549378" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8f949882c14a1f95d283300fa1be87" is_pre_election: true
I20260812 00:27:28.732088 1195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "073b06f2b9864a29b58ec26bef549378" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bfdd1d890a48bda422f647e270e8fa" is_pre_election: true
I20260812 00:27:28.732378 1195 raft_consensus.cc:2454] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 0.
I20260812 00:27:28.732378 795 raft_consensus.cc:2454] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 0.
I20260812 00:27:28.732975 900 leader_election.cc:302] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, ac8f949882c14a1f95d283300fa1be87, e8bfdd1d890a48bda422f647e270e8fa; no voters:
I20260812 00:27:28.733376 1390 raft_consensus.cc:2781] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:28.733541 1390 raft_consensus.cc:482] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:28.733662 1390 raft_consensus.cc:3037] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:28.736011 1390 raft_consensus.cc:504] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.736709 1390 leader_election.cc:288] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 election: Requested vote from peers ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347), e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767)
I20260812 00:27:28.737407 1195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "073b06f2b9864a29b58ec26bef549378" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8bfdd1d890a48bda422f647e270e8fa"
I20260812 00:27:28.737432 795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "073b06f2b9864a29b58ec26bef549378" candidate_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8f949882c14a1f95d283300fa1be87"
I20260812 00:27:28.737697 795 raft_consensus.cc:3037] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:28.737722 1195 raft_consensus.cc:3037] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:28.740921 795 raft_consensus.cc:2454] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 1.
I20260812 00:27:28.740904 1195 raft_consensus.cc:2454] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dcf04bbdcae45b1a39c05665c8f0134 in term 1.
I20260812 00:27:28.741684 900 leader_election.cc:302] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, ac8f949882c14a1f95d283300fa1be87; no voters:
I20260812 00:27:28.742129 1390 raft_consensus.cc:2781] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:28.742324 1390 raft_consensus.cc:686] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 LEADER]: Becoming Leader. State: Replica: 2dcf04bbdcae45b1a39c05665c8f0134, State: Running, Role: LEADER
I20260812 00:27:28.742641 1390 consensus_queue.cc:237] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.746150 585 catalog_manager.cc:5495] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } health_report { overall_health: UNKNOWN } } }
I20260812 00:27:28.791298 1445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:28.783364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58092 (local address 127.29.190.130:39643)
0812 00:27:28.786142 (+ 2778us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:28.786147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:28.786169 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:27:28.786235 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:28.786239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:28.786305 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:28.786448 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:28.786970 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:28.787870 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:28.789287 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:28.789762 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:28.789912 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:28.790422 (+ 510us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:28.790562 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:28.790669 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:28.790847 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 00:27:28.790933 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2661,"thread_start_us":2529,"threads_started":1}
I20260812 00:27:28.801851 795 raft_consensus.cc:1261] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Refusing update from remote peer 2dcf04bbdcae45b1a39c05665c8f0134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:28.801872 1195 raft_consensus.cc:1261] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Refusing update from remote peer 2dcf04bbdcae45b1a39c05665c8f0134: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:28.802489 1399 consensus_queue.cc:1035] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:28.802814 1390 consensus_queue.cc:1035] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:28.851646 585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:28.851912 585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:28.854898 585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: Sending DeleteTablet for 3 replicas of tablet 073b06f2b9864a29b58ec26bef549378
I20260812 00:27:28.855774 967 tablet_service.cc:1514] Processing DeleteTablet for tablet 073b06f2b9864a29b58ec26bef549378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:28 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:39668
I20260812 00:27:28.855774 771 tablet_service.cc:1514] Processing DeleteTablet for tablet 073b06f2b9864a29b58ec26bef549378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:28 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:60512
I20260812 00:27:28.855989 1161 tablet_service.cc:1514] Processing DeleteTablet for tablet 073b06f2b9864a29b58ec26bef549378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:28 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:48066
I20260812 00:27:28.856058 1417 tablet_replica.cc:330] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: stopping tablet replica
I20260812 00:27:28.856082 1419 tablet_replica.cc:330] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: stopping tablet replica
I20260812 00:27:28.856266 1417 raft_consensus.cc:2229] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:28.856266 1419 raft_consensus.cc:2229] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:27:28.856456 1417 raft_consensus.cc:2258] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:28.856600 1419 raft_consensus.cc:2258] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:28.856755 1420 tablet_replica.cc:330] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: stopping tablet replica
I20260812 00:27:28.856967 1420 raft_consensus.cc:2229] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:28.857182 1420 raft_consensus.cc:2258] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:28.857137 585 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:27:28.857687 1417 ts_tablet_manager.cc:1905] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 00:27:28.857859 585 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:28.858412 1419 ts_tablet_manager.cc:1905] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:28.859009 1420 ts_tablet_manager.cc:1905] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:28.864142 1420 ts_tablet_manager.cc:1918] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:28.864331 1420 log.cc:1196] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/073b06f2b9864a29b58ec26bef549378
I20260812 00:27:28.864424 1417 ts_tablet_manager.cc:1918] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:28.864576 1417 log.cc:1196] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/073b06f2b9864a29b58ec26bef549378
I20260812 00:27:28.864845 1420 ts_tablet_manager.cc:1939] T 073b06f2b9864a29b58ec26bef549378 P e8bfdd1d890a48bda422f647e270e8fa: Deleting consensus metadata
I20260812 00:27:28.865020 1417 ts_tablet_manager.cc:1939] T 073b06f2b9864a29b58ec26bef549378 P ac8f949882c14a1f95d283300fa1be87: Deleting consensus metadata
I20260812 00:27:28.865015 1419 ts_tablet_manager.cc:1918] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:27:28.865170 1419 log.cc:1196] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/073b06f2b9864a29b58ec26bef549378
I20260812 00:27:28.865607 1419 ts_tablet_manager.cc:1939] T 073b06f2b9864a29b58ec26bef549378 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting consensus metadata
I20260812 00:27:28.866011 566 catalog_manager.cc:4841] TS e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767): tablet 073b06f2b9864a29b58ec26bef549378 (table test-table [id=9ce4a799b5864761b3aaa60104118708]) successfully deleted
I20260812 00:27:28.866719 566 catalog_manager.cc:4841] TS 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643): tablet 073b06f2b9864a29b58ec26bef549378 (table test-table [id=9ce4a799b5864761b3aaa60104118708]) successfully deleted
I20260812 00:27:28.867074 565 catalog_manager.cc:4841] TS ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347): tablet 073b06f2b9864a29b58ec26bef549378 (table test-table [id=9ce4a799b5864761b3aaa60104118708]) successfully deleted
I20260812 00:27:28.870559 771 tablet_service.cc:1467] Processing CreateTablet for tablet 994a6e19f7444f748be96f956afdf9b2 (DEFAULT_TABLE table=test-table [id=c230af1a8a464f2bbfbbd59cdb2ecd9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:28.870609 967 tablet_service.cc:1467] Processing CreateTablet for tablet 994a6e19f7444f748be96f956afdf9b2 (DEFAULT_TABLE table=test-table [id=c230af1a8a464f2bbfbbd59cdb2ecd9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:28.870716 1161 tablet_service.cc:1467] Processing CreateTablet for tablet 994a6e19f7444f748be96f956afdf9b2 (DEFAULT_TABLE table=test-table [id=c230af1a8a464f2bbfbbd59cdb2ecd9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:28.871068 771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 994a6e19f7444f748be96f956afdf9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:28.871120 967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 994a6e19f7444f748be96f956afdf9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:28.871141 1161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 994a6e19f7444f748be96f956afdf9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:28.875947 1437 tablet_bootstrap.cc:492] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: Bootstrap starting.
I20260812 00:27:28.877571 1437 tablet_bootstrap.cc:654] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:28.877712 1438 tablet_bootstrap.cc:492] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: Bootstrap starting.
I20260812 00:27:28.878643 1436 tablet_bootstrap.cc:492] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: Bootstrap starting.
I20260812 00:27:28.879766 1438 tablet_bootstrap.cc:654] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:28.880211 1436 tablet_bootstrap.cc:654] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:28.882457 1438 tablet_bootstrap.cc:492] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: No bootstrap required, opened a new log
I20260812 00:27:28.882750 1438 ts_tablet_manager.cc:1397] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260812 00:27:28.883889 1438 raft_consensus.cc:348] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.884368 1438 raft_consensus.cc:374] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:28.884516 1438 raft_consensus.cc:729] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8f949882c14a1f95d283300fa1be87, State: Initialized, Role: FOLLOWER
I20260812 00:27:28.884985 1438 consensus_queue.cc:260] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.886888 1438 ts_tablet_manager.cc:1428] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 00:27:28.887920 1436 tablet_bootstrap.cc:492] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: No bootstrap required, opened a new log
I20260812 00:27:28.888129 1436 ts_tablet_manager.cc:1397] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260812 00:27:28.888921 1436 raft_consensus.cc:348] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.889199 1436 raft_consensus.cc:374] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:28.889256 1437 tablet_bootstrap.cc:492] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: No bootstrap required, opened a new log
I20260812 00:27:28.889292 1436 raft_consensus.cc:729] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bfdd1d890a48bda422f647e270e8fa, State: Initialized, Role: FOLLOWER
I20260812 00:27:28.889518 1437 ts_tablet_manager.cc:1397] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.004s
I20260812 00:27:28.889567 1436 consensus_queue.cc:260] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.890237 1436 ts_tablet_manager.cc:1428] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 00:27:28.890547 1437 raft_consensus.cc:348] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.890833 1437 raft_consensus.cc:374] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:28.890928 1437 raft_consensus.cc:729] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dcf04bbdcae45b1a39c05665c8f0134, State: Initialized, Role: FOLLOWER
I20260812 00:27:28.891217 1437 consensus_queue.cc:260] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:28.891808 1437 ts_tablet_manager.cc:1428] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 00:27:29.133672 1442 raft_consensus.cc:482] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:29.134001 1442 raft_consensus.cc:504] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:29.136092 1442 leader_election.cc:288] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347), 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643)
I20260812 00:27:29.142849 1445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.136870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:48055 (local address 127.29.190.130:39643)
0812 00:27:29.137086 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:29.137093 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:29.137348 (+ 255us) server_negotiation.cc:407] Connection header received
0812 00:27:29.137761 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:29.137771 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:29.137872 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:29.137990 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:29.138520 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.139257 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.141075 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.141884 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.142068 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.142154 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:29.142454 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 00:27:29.142599 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:27:29.143009 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.136416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39643 (local address 127.29.190.131:48055)
0812 00:27:29.137224 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:29.137245 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:29.137518 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:29.138007 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:29.138011 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:29.138039 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:29.138339 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:29.138349 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.139424 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.139430 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:29.140898 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:29.140912 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.142122 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.142128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:29.142285 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.142309 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 00:27:29.142423 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:27:29.142564 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":1,"thread_start_us":678,"threads_started":1}
I20260812 00:27:29.143651 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.136728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:46347 (local address 127.29.190.131:42205)
0812 00:27:29.137732 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:29.137753 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:29.137867 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:29.138636 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:29.138640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:29.138666 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:29.139029 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:29.139038 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.140165 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.140169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:29.141558 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:29.141570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.142731 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.142737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:29.142909 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.142972 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 00:27:29.143069 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 00:27:29.143330 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"thread_start_us":656,"threads_started":1}
I20260812 00:27:29.143759 1458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.136546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:42205 (local address 127.29.190.129:46347)
0812 00:27:29.138345 (+ 1799us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:29.138349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:29.138365 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:27:29.138424 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:29.138427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:29.138492 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:29.138615 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:29.139208 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.140024 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.141729 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.142511 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.142725 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.142806 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:29.143251 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 00:27:29.143407 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1688,"thread_start_us":1263,"threads_started":1}
I20260812 00:27:29.143821 1000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "994a6e19f7444f748be96f956afdf9b2" candidate_uuid: "e8bfdd1d890a48bda422f647e270e8fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" is_pre_election: true
I20260812 00:27:29.144160 1000 raft_consensus.cc:2454] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bfdd1d890a48bda422f647e270e8fa in term 0.
I20260812 00:27:29.144547 795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "994a6e19f7444f748be96f956afdf9b2" candidate_uuid: "e8bfdd1d890a48bda422f647e270e8fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8f949882c14a1f95d283300fa1be87" is_pre_election: true
I20260812 00:27:29.144809 795 raft_consensus.cc:2454] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8bfdd1d890a48bda422f647e270e8fa in term 0.
I20260812 00:27:29.144819 1095 leader_election.cc:302] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, e8bfdd1d890a48bda422f647e270e8fa; no voters:
I20260812 00:27:29.145358 1442 raft_consensus.cc:2781] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:29.145503 1442 raft_consensus.cc:482] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:29.145601 1442 raft_consensus.cc:3037] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:29.148181 1442 raft_consensus.cc:504] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:29.148904 1442 leader_election.cc:288] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [CANDIDATE]: Term 1 election: Requested vote from peers ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347), 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643)
I20260812 00:27:29.149441 795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "994a6e19f7444f748be96f956afdf9b2" candidate_uuid: "e8bfdd1d890a48bda422f647e270e8fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8f949882c14a1f95d283300fa1be87"
I20260812 00:27:29.149500 1000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "994a6e19f7444f748be96f956afdf9b2" candidate_uuid: "e8bfdd1d890a48bda422f647e270e8fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dcf04bbdcae45b1a39c05665c8f0134"
I20260812 00:27:29.149657 795 raft_consensus.cc:3037] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:29.149721 1000 raft_consensus.cc:3037] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:29.151850 1000 raft_consensus.cc:2454] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bfdd1d890a48bda422f647e270e8fa in term 1.
I20260812 00:27:29.151852 795 raft_consensus.cc:2454] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8bfdd1d890a48bda422f647e270e8fa in term 1.
I20260812 00:27:29.152293 1095 leader_election.cc:302] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dcf04bbdcae45b1a39c05665c8f0134, e8bfdd1d890a48bda422f647e270e8fa; no voters:
I20260812 00:27:29.152688 1442 raft_consensus.cc:2781] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:29.153189 1442 raft_consensus.cc:686] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 1 LEADER]: Becoming Leader. State: Replica: e8bfdd1d890a48bda422f647e270e8fa, State: Running, Role: LEADER
I20260812 00:27:29.153591 1442 consensus_queue.cc:237] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } }
I20260812 00:27:29.157456 583 catalog_manager.cc:5495] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa reported cstate change: term changed from 0 to 1, leader changed from <none> to e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131). New cstate: current_term: 1 leader_uuid: "e8bfdd1d890a48bda422f647e270e8fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8bfdd1d890a48bda422f647e270e8fa" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 33767 } health_report { overall_health: HEALTHY } } }
I20260812 00:27:29.200093 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.192795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40944 (local address 127.29.190.131:33767)
0812 00:27:29.193503 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:29.193508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:29.193532 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:27:29.193633 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:29.193638 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:29.193723 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:29.193950 (+ 227us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:29.194522 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.195594 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.197166 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.197687 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.197871 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.198481 (+ 610us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:29.199189 (+ 708us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:29.199383 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:29.199551 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 00:27:29.199655 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":360,"threads_started":1}
I20260812 00:27:29.217549 1445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.211621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:45071 (local address 127.29.190.130:39643)
0812 00:27:29.211804 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:29.211809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:29.212494 (+ 685us) server_negotiation.cc:407] Connection header received
0812 00:27:29.212734 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:29.212738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:29.212838 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:29.212942 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:29.213440 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.214194 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.215722 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.216147 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.216295 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.216767 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:29.216882 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:29.216983 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:29.217143 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 00:27:29.217232 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:27:29.217621 1470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.211679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39643 (local address 127.29.190.131:45071)
0812 00:27:29.212376 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:29.212392 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:29.212577 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:29.212963 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:29.212967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:29.212979 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:29.213292 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:29.213300 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.214343 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.214348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:29.215580 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:29.215593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.216339 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.216348 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:29.216488 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.216550 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:29.216986 (+ 436us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:29.217000 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:27:29.217107 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 00:27:29.217247 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":325,"threads_started":1}
I20260812 00:27:29.226058 1000 raft_consensus.cc:1261] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Refusing update from remote peer e8bfdd1d890a48bda422f647e270e8fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:29.226073 795 raft_consensus.cc:1261] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Refusing update from remote peer e8bfdd1d890a48bda422f647e270e8fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:29.226732 1461 consensus_queue.cc:1035] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8f949882c14a1f95d283300fa1be87" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:29.227093 1442 consensus_queue.cc:1035] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dcf04bbdcae45b1a39c05665c8f0134" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:29.257128 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.250821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:52757 (local address 127.29.190.131:33767)
0812 00:27:29.250981 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:29.250986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:29.251605 (+ 619us) server_negotiation.cc:407] Connection header received
0812 00:27:29.251750 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:29.251754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:29.251820 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:29.251891 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:29.252363 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.253320 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.255390 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.255834 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.255936 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.256459 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:29.256571 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:29.256648 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:29.256841 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 00:27:29.256907 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:27:29.257310 1476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:29.250713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:33767 (local address 127.29.190.130:52757)
0812 00:27:29.251514 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:29.251530 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:29.251643 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:29.251895 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:29.251898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:29.251905 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:27:29.252213 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:29.252221 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.253468 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.253473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:29.255253 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:29.255268 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:29.256090 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:29.256096 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:29.256236 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:29.256281 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:27:29.256703 (+ 422us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:27:29.256717 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 00:27:29.256808 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:27:29.256926 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":448,"threads_started":1}
W20260812 00:27:29.258646 1394 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 00:27:30.867276 585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:30.867590 585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:30.872552 585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 98910580b3af4236a88510c8192eaaa0: Sending DeleteTablet for 3 replicas of tablet 994a6e19f7444f748be96f956afdf9b2
I20260812 00:27:30.873471 771 tablet_service.cc:1514] Processing DeleteTablet for tablet 994a6e19f7444f748be96f956afdf9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:30 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:60512
I20260812 00:27:30.873471 967 tablet_service.cc:1514] Processing DeleteTablet for tablet 994a6e19f7444f748be96f956afdf9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:30 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:39668
I20260812 00:27:30.873499 1161 tablet_service.cc:1514] Processing DeleteTablet for tablet 994a6e19f7444f748be96f956afdf9b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:30 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:48066
I20260812 00:27:30.877084 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 675
I20260812 00:27:30.886063 1518 tablet_replica.cc:330] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: stopping tablet replica
I20260812 00:27:30.886294 1516 tablet_replica.cc:330] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: stopping tablet replica
I20260812 00:27:30.886339 1518 raft_consensus.cc:2229] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:30.886662 1516 raft_consensus.cc:2229] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:30.887123 1516 raft_consensus.cc:2258] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:30.887562 1518 raft_consensus.cc:2258] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:30.888482 1516 ts_tablet_manager.cc:1905] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:30.888808 1518 ts_tablet_manager.cc:1905] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:30.892666 1517 tablet_replica.cc:330] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: stopping tablet replica
I20260812 00:27:30.893005 1517 raft_consensus.cc:2229] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:27:30.893759 1517 raft_consensus.cc:2258] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:30.894953 1517 ts_tablet_manager.cc:1905] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:30.895933 1518 ts_tablet_manager.cc:1918] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:27:30.896154 1518 log.cc:1196] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/994a6e19f7444f748be96f956afdf9b2
I20260812 00:27:30.896724 1518 ts_tablet_manager.cc:1939] T 994a6e19f7444f748be96f956afdf9b2 P 2dcf04bbdcae45b1a39c05665c8f0134: Deleting consensus metadata
I20260812 00:27:30.896780 1516 ts_tablet_manager.cc:1918] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:27:30.896953 1516 log.cc:1196] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/994a6e19f7444f748be96f956afdf9b2
I20260812 00:27:30.897516 1516 ts_tablet_manager.cc:1939] T 994a6e19f7444f748be96f956afdf9b2 P ac8f949882c14a1f95d283300fa1be87: Deleting consensus metadata
I20260812 00:27:30.898437 566 catalog_manager.cc:4841] TS 2dcf04bbdcae45b1a39c05665c8f0134 (127.29.190.130:39643): tablet 994a6e19f7444f748be96f956afdf9b2 (table test-table [id=c230af1a8a464f2bbfbbd59cdb2ecd9c]) successfully deleted
I20260812 00:27:30.898649 565 catalog_manager.cc:4841] TS ac8f949882c14a1f95d283300fa1be87 (127.29.190.129:46347): tablet 994a6e19f7444f748be96f956afdf9b2 (table test-table [id=c230af1a8a464f2bbfbbd59cdb2ecd9c]) successfully deleted
I20260812 00:27:30.901026 1517 ts_tablet_manager.cc:1918] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 00:27:30.901201 1517 log.cc:1196] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/994a6e19f7444f748be96f956afdf9b2
I20260812 00:27:30.901631 1517 ts_tablet_manager.cc:1939] T 994a6e19f7444f748be96f956afdf9b2 P e8bfdd1d890a48bda422f647e270e8fa: Deleting consensus metadata
I20260812 00:27:30.902671 566 catalog_manager.cc:4841] TS e8bfdd1d890a48bda422f647e270e8fa (127.29.190.131:33767): tablet 994a6e19f7444f748be96f956afdf9b2 (table test-table [id=c230af1a8a464f2bbfbbd59cdb2ecd9c]) successfully deleted
Aug 12 00:27:30 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:30.910756 1520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:30.878725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54188 (local address 127.29.190.129:46347)
0812 00:27:30.891978 (+ 13253us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:30.891989 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:30.892811 (+ 822us) server_negotiation.cc:407] Connection header received
0812 00:27:30.892885 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:30.892890 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:30.892978 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:30.893116 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:30.895098 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:30.896335 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:30.898204 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:30.898854 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:30.898998 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:30.904331 (+ 5333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:30.904350 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:30.904367 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:30.904407 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:30.907495 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:30.908431 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:30.908439 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:30.908442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:30.908629 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:30.909056 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:30.909060 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:30.909063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:30.909483 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:30.909750 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:30.910089 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 00:27:30.910292 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13047,"thread_start_us":12898,"threads_started":1}
W20260812 00:27:30.911559 860 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54188
W20260812 00:27:30.912261 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 675: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:30.912500 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 675
I20260812 00:27:30.953413 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 871
Aug 12 00:27:30 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:27:30.969432 1521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:30.954198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58094 (local address 127.29.190.130:39643)
0812 00:27:30.954761 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:30.954765 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:30.954782 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:27:30.954838 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:30.954841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:30.954899 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:30.955000 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:30.956397 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:30.957138 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:30.958393 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:30.958849 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:30.958947 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:30.963347 (+ 4400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:30.963364 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:30.963382 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:30.963418 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:30.966410 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:30.967168 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:30.967176 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:30.967179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:30.967315 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:30.967766 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:30.967772 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:30.967777 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:30.968158 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:30.968487 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:30.968814 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 00:27:30.969047 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":302,"threads_started":1}
W20260812 00:27:30.970115 1054 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58094
W20260812 00:27:30.970806 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 871: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:30.970939 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 871
I20260812 00:27:31.006107 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 1065
Aug 12 00:27:31 dist-test-slave-c12x krb5kdc[519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:27:31.022270 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:31.006885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40960 (local address 127.29.190.131:33767)
0812 00:27:31.007528 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:31.007533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:31.007549 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:27:31.007607 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:31.007611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:31.007672 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:31.007764 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:31.009069 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:31.009832 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:31.011037 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:31.011586 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:31.011707 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:31.016122 (+ 4415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:31.016146 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:31.016168 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:31.016208 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:31.019316 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:31.020087 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:31.020095 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:31.020098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:31.020270 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:31.020633 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:31.020637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:31.020639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:31.021073 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:31.021316 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:31.021671 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 00:27:31.021936 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":337,"threads_started":1}
W20260812 00:27:31.022998 1250 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40960
W20260812 00:27:31.023753 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 1065: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:31.023964 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 1065
I20260812 00:27:31.057433 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 540
I20260812 00:27:31.058840 633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:31.179529 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 540
2026-08-12T00:27:31Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9312 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:31 dist-test-slave-c12x krb5kdc[1531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:31 dist-test-slave-c12x krb5kdc[1531](info): set up 2 sockets
Aug 12 00:27:31 dist-test-slave-c12x krb5kdc[1531](info): commencing operation
krb5kdc: starting...
W20260812 00:27:32.565563 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:32 dist-test-slave-c12x krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:32.800262 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42589
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:42589
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:33.160023 1553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:33.160333 1553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:33.160429 1553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:33.168267 1553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:33.168402 1553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:33.168453 1553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:33.168514 1553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:33.168561 1553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:33.178725 1553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:42589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:33.180193 1553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:33.181506 1553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:33.194341 1561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:33.194322 1568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:33.194686 1562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:33.197341 1553 server_base.cc:1034] running on GCE node
I20260812 00:27:33.198371 1553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:33.200114 1553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:33.201393 1553 hybrid_clock.cc:648] HybridClock initialized: now 1786494453201346 us; error 56 us; skew 500 ppm
I20260812 00:27:33.201829 1553 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:33 dist-test-slave-c12x krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494453, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:33.205557 1553 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:33.207361 1553 webserver.cc:460] Webserver started at http://127.29.190.190:40681/ using document root <none> and password file <none>
I20260812 00:27:33.208216 1553 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:33.208389 1553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:33.208752 1553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:33.212286 1553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "eaa03f5c907d4dfca5638ecbcede0342"
format_stamp: "Formatted at 2026-08-12 00:27:33 on dist-test-slave-c12x"
server_key: "4a0f860d3d84042730ca66e6c466836d"
server_key_iv: "b2e9e35319c437f2cae0fc81987c660e"
server_key_version: "encryptionkey@0"
I20260812 00:27:33.213166 1553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "eaa03f5c907d4dfca5638ecbcede0342"
format_stamp: "Formatted at 2026-08-12 00:27:33 on dist-test-slave-c12x"
server_key: "4a0f860d3d84042730ca66e6c466836d"
server_key_iv: "b2e9e35319c437f2cae0fc81987c660e"
server_key_version: "encryptionkey@0"
I20260812 00:27:33.219029 1553 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 00:27:33.222872 1580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:33.224469 1553 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:27:33.224684 1553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "eaa03f5c907d4dfca5638ecbcede0342"
format_stamp: "Formatted at 2026-08-12 00:27:33 on dist-test-slave-c12x"
server_key: "4a0f860d3d84042730ca66e6c466836d"
server_key_iv: "b2e9e35319c437f2cae0fc81987c660e"
server_key_version: "encryptionkey@0"
I20260812 00:27:33.224910 1553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:33.244582 1553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:33.249418 1553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:33.249747 1553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:33.269806 1553 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:42589
I20260812 00:27:33.269856 1652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:42589 every 8 connection(s)
I20260812 00:27:33.271338 1553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:33.274345 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 1553
I20260812 00:27:33.274605 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:33.275287 30458 external_mini_cluster.cc:1428] Setting key 6025ac2717ae2e0d1ae04cccee4ca947
I20260812 00:27:33.275564 1654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:33.291127 1654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342: Bootstrap starting.
Aug 12 00:27:33 dist-test-slave-c12x krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:33.295166 1654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:33.296674 1654 log.cc:824] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:33.300457 1654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342: No bootstrap required, opened a new log
I20260812 00:27:33.302577 1660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:33.277440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49412 (local address 127.29.190.190:42589)
0812 00:27:33.278279 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:33.278295 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:33.278340 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:27:33.280817 (+ 2477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:33.280844 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:33.281295 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:33.281678 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:33.283721 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:33.285208 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:33.287159 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:33.288138 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:33.288301 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:33.293413 (+ 5112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:33.293425 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:33.293446 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:33.293506 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:33.297721 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:33.298617 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:33.298626 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:33.298634 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:33.298850 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:33.299228 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:33.299233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:33.299236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:33.300014 (+ 778us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:33.300310 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:33.300687 (+ 377us) server_negotiation.cc:299] Negotiation successful
0812 00:27:33.301181 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":398,"threads_started":1}
I20260812 00:27:33.309402 1654 raft_consensus.cc:348] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa03f5c907d4dfca5638ecbcede0342" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42589 } }
I20260812 00:27:33.309760 1654 raft_consensus.cc:374] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:33.309835 1654 raft_consensus.cc:729] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa03f5c907d4dfca5638ecbcede0342, State: Initialized, Role: FOLLOWER
I20260812 00:27:33.310335 1654 consensus_queue.cc:260] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa03f5c907d4dfca5638ecbcede0342" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42589 } }
I20260812 00:27:33.310544 1654 raft_consensus.cc:388] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:33.310645 1654 raft_consensus.cc:482] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:33.310760 1654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:33.313316 1654 raft_consensus.cc:504] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa03f5c907d4dfca5638ecbcede0342" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42589 } }
I20260812 00:27:33.313794 1654 leader_election.cc:302] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eaa03f5c907d4dfca5638ecbcede0342; no voters:
I20260812 00:27:33.314370 1654 leader_election.cc:288] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:33.314549 1663 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:33.315279 1663 raft_consensus.cc:686] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [term 1 LEADER]: Becoming Leader. State: Replica: eaa03f5c907d4dfca5638ecbcede0342, State: Running, Role: LEADER
I20260812 00:27:33.315891 1663 consensus_queue.cc:237] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa03f5c907d4dfca5638ecbcede0342" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42589 } }
I20260812 00:27:33.316637 1654 sys_catalog.cc:564] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:33.318841 1664 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eaa03f5c907d4dfca5638ecbcede0342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa03f5c907d4dfca5638ecbcede0342" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42589 } } }
I20260812 00:27:33.319267 1664 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:33.319214 1666 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eaa03f5c907d4dfca5638ecbcede0342. Latest consensus state: current_term: 1 leader_uuid: "eaa03f5c907d4dfca5638ecbcede0342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa03f5c907d4dfca5638ecbcede0342" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42589 } } }
I20260812 00:27:33.320022 1666 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:33.321179 1670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:33.327132 1670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:33.336717 1670 catalog_manager.cc:1347] Generated new cluster ID: 552ee16aedd24caf8ec39abcf36fbb79
I20260812 00:27:33.336851 1670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:33.356806 1670 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:33.358413 1670 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:33.369035 1670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eaa03f5c907d4dfca5638ecbcede0342: Generated new TSK 0
I20260812 00:27:33.370014 1670 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:27:33.443993 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42589
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:33.806103 1689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:33.806466 1689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:33.806568 1689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:33.814155 1689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:33.814282 1689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:33.814399 1689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:33.825058 1689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:33.826411 1689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:33.827875 1689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:33.843081 1697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:33.843128 1698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:33.843047 1700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:33.849565 1689 server_base.cc:1034] running on GCE node
I20260812 00:27:33.850382 1689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:33.851545 1689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:33.852806 1689 hybrid_clock.cc:648] HybridClock initialized: now 1786494453852753 us; error 38 us; skew 500 ppm
I20260812 00:27:33.853168 1689 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:33 dist-test-slave-c12x krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494453, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:33.860795 1689 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:27:33.862462 1689 webserver.cc:460] Webserver started at http://127.29.190.129:34551/ using document root <none> and password file <none>
I20260812 00:27:33.863190 1689 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:33.863296 1689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:33.863641 1689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:33.866801 1689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "71ac8da680ee4f848096784eec4bd10e"
format_stamp: "Formatted at 2026-08-12 00:27:33 on dist-test-slave-c12x"
server_key: "114a0fa6163b9fd4e407deb97fcbed4f"
server_key_iv: "f66fde2102279a1f1ab454f7d39e3d0e"
server_key_version: "encryptionkey@0"
I20260812 00:27:33.867731 1689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "71ac8da680ee4f848096784eec4bd10e"
format_stamp: "Formatted at 2026-08-12 00:27:33 on dist-test-slave-c12x"
server_key: "114a0fa6163b9fd4e407deb97fcbed4f"
server_key_iv: "f66fde2102279a1f1ab454f7d39e3d0e"
server_key_version: "encryptionkey@0"
I20260812 00:27:33.873208 1689 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:27:33.877163 1708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:33.878722 1689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:27:33.878932 1689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "71ac8da680ee4f848096784eec4bd10e"
format_stamp: "Formatted at 2026-08-12 00:27:33 on dist-test-slave-c12x"
server_key: "114a0fa6163b9fd4e407deb97fcbed4f"
server_key_iv: "f66fde2102279a1f1ab454f7d39e3d0e"
server_key_version: "encryptionkey@0"
I20260812 00:27:33.879187 1689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:33.903862 1689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:33.909060 1689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:33.909420 1689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:33.910485 1689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:33.911985 1689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:33.912096 1689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:33.912249 1689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:33.912325 1689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:33.948428 1689 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:41287
I20260812 00:27:33.948524 1880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:41287 every 8 connection(s)
I20260812 00:27:33.949856 1689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:33.958763 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 1689
I20260812 00:27:33.959017 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:33.959771 30458 external_mini_cluster.cc:1428] Setting key 3b60258c3c11b5fece2df49355e1c765
Aug 12 00:27:33 dist-test-slave-c12x krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494453, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:33.972757 1883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:33.952658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:49003 (local address 127.29.190.190:42589)
0812 00:27:33.953142 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:33.953146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:33.953966 (+ 820us) server_negotiation.cc:407] Connection header received
0812 00:27:33.956018 (+ 2052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:33.956024 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:33.956126 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:33.956256 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:33.957869 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:33.958910 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:33.960931 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:33.961599 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:33.961754 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:33.966361 (+ 4607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:33.966368 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:33.966371 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:33.966410 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:33.969218 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:33.970117 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:33.970122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:33.970124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:33.970256 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:33.970762 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:33.970766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:33.970768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:33.971059 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:33.971230 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:33.972109 (+ 879us) server_negotiation.cc:299] Negotiation successful
0812 00:27:33.972364 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":375,"thread_start_us":267,"threads_started":1}
I20260812 00:27:33.973886 1884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:33.953073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42589 (local address 127.29.190.129:49003)
0812 00:27:33.953798 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:33.953837 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:33.955722 (+ 1885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:33.956517 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:33.956526 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:33.957070 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:33.957683 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:33.957702 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:33.959143 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:33.959150 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:33.960762 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:33.960778 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:33.961891 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:33.961921 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:33.962241 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:33.963028 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:33.963062 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:33.966005 (+ 2943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:33.969405 (+ 3400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:33.969417 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:33.969438 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:33.969955 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:33.970381 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:33.970386 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:33.970390 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:33.970621 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:33.971211 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:33.971220 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:33.971684 (+ 464us) client_negotiation.cc:769] Sending connection context
0812 00:27:33.971976 (+ 292us) client_negotiation.cc:240] Negotiation successful
0812 00:27:33.972592 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":283,"threads_started":1}
I20260812 00:27:33.975832 1881 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42589
I20260812 00:27:33.976203 1881 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:33.976994 1881 heartbeater.cc:511] Master 127.29.190.190:42589 requested a full tablet report, sending...
I20260812 00:27:33.979686 1600 ts_manager.cc:194] Registered new tserver with Master: 71ac8da680ee4f848096784eec4bd10e (127.29.190.129:41287)
I20260812 00:27:33.982059 1600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:49003
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:27:34.013088 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42589
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:34.372346 1889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:34.372651 1889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:34.372828 1889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:34.380505 1889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:34.380633 1889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:34.380811 1889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:34.390976 1889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:34.392447 1889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:34.393823 1889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:34.408162 1895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:34.408198 1896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:34.408243 1898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:34.409144 1889 server_base.cc:1034] running on GCE node
I20260812 00:27:34.409881 1889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:34.410998 1889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:34.412248 1889 hybrid_clock.cc:648] HybridClock initialized: now 1786494454412209 us; error 71 us; skew 500 ppm
I20260812 00:27:34.412606 1889 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:34 dist-test-slave-c12x krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494454, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:34.416181 1889 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:27:34.417882 1889 webserver.cc:460] Webserver started at http://127.29.190.130:40149/ using document root <none> and password file <none>
I20260812 00:27:34.418633 1889 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:34.418738 1889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:34.419020 1889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:34.422102 1889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "5271c2ca4d7b40e6b3e6a2ce09dc1eeb"
format_stamp: "Formatted at 2026-08-12 00:27:34 on dist-test-slave-c12x"
server_key: "9682c5953ed04ebf8fac3029cd51bf3b"
server_key_iv: "45db8d3eaf8e582e832953e402742051"
server_key_version: "encryptionkey@0"
I20260812 00:27:34.422987 1889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "5271c2ca4d7b40e6b3e6a2ce09dc1eeb"
format_stamp: "Formatted at 2026-08-12 00:27:34 on dist-test-slave-c12x"
server_key: "9682c5953ed04ebf8fac3029cd51bf3b"
server_key_iv: "45db8d3eaf8e582e832953e402742051"
server_key_version: "encryptionkey@0"
I20260812 00:27:34.428706 1889 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260812 00:27:34.432355 1909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:34.433948 1889 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:27:34.434150 1889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "5271c2ca4d7b40e6b3e6a2ce09dc1eeb"
format_stamp: "Formatted at 2026-08-12 00:27:34 on dist-test-slave-c12x"
server_key: "9682c5953ed04ebf8fac3029cd51bf3b"
server_key_iv: "45db8d3eaf8e582e832953e402742051"
server_key_version: "encryptionkey@0"
I20260812 00:27:34.434360 1889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:34.454250 1889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:34.459136 1889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:34.459509 1889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:34.460616 1889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:34.462152 1889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:34.462230 1889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:34.462381 1889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:34.462481 1889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:34.500700 1889 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:40339
I20260812 00:27:34.500747 2088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:40339 every 8 connection(s)
I20260812 00:27:34.502099 1889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:34.507792 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 1889
I20260812 00:27:34.508008 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:34.508463 30458 external_mini_cluster.cc:1428] Setting key bca8efbf14fa6495a5861a03e77b9511
Aug 12 00:27:34 dist-test-slave-c12x krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494454, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:34.526578 2091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:34.505036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:48667 (local address 127.29.190.190:42589)
0812 00:27:34.505503 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:34.505508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:34.506632 (+ 1124us) server_negotiation.cc:407] Connection header received
0812 00:27:34.508751 (+ 2119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:34.508757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:34.508852 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:34.508978 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:34.510846 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:34.512090 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:34.513738 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:34.514514 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:34.514666 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:34.519084 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:34.519090 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:34.519094 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:34.519131 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:34.522568 (+ 3437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:34.523725 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:34.523730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:34.523732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:34.523874 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:34.524499 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:34.524503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:34.524505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:34.524799 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:34.524948 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:34.526039 (+ 1091us) server_negotiation.cc:299] Negotiation successful
0812 00:27:34.526235 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":234,"threads_started":1}
I20260812 00:27:34.528220 2092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:34.505596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42589 (local address 127.29.190.130:48667)
0812 00:27:34.506422 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:34.506500 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:34.508433 (+ 1933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:34.509273 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:34.509286 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:34.509864 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:34.510636 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:34.510665 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:34.512274 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:34.512279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:34.513566 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:34.513580 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:34.514756 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:34.514761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:34.514985 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:34.515841 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:34.515870 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:34.518755 (+ 2885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:34.522743 (+ 3988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:34.522757 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:34.522781 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:34.523593 (+ 812us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:34.524016 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:34.524023 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:34.524029 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:34.524316 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:34.524944 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:34.524956 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:34.525538 (+ 582us) client_negotiation.cc:769] Sending connection context
0812 00:27:34.525875 (+ 337us) client_negotiation.cc:240] Negotiation successful
0812 00:27:34.526549 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":281,"threads_started":1}
I20260812 00:27:34.529999 2089 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42589
I20260812 00:27:34.530337 2089 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:34.531142 2089 heartbeater.cc:511] Master 127.29.190.190:42589 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
I20260812 00:27:34.532778 1600 ts_manager.cc:194] Registered new tserver with Master: 5271c2ca4d7b40e6b3e6a2ce09dc1eeb (127.29.190.130:40339)
I20260812 00:27:34.533692 1600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:48667
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:27:34.563042 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42589
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:34.926004 2097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:34.926378 2097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:34.926569 2097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:34.935046 2097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:34.935226 2097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:34.935415 2097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:34.945820 2097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:34.947240 2097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:34.948787 2097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:34.963039 2105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:34.963076 2110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:34.962983 2104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:34.964167 2097 server_base.cc:1034] running on GCE node
I20260812 00:27:34.964890 2097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:34.966156 2097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:34.967422 2097 hybrid_clock.cc:648] HybridClock initialized: now 1786494454967379 us; error 85 us; skew 500 ppm
I20260812 00:27:34.967883 2097 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:34 dist-test-slave-c12x krb5kdc[1531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494454, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:34.971637 2097 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:27:34.973214 2097 webserver.cc:460] Webserver started at http://127.29.190.131:40747/ using document root <none> and password file <none>
I20260812 00:27:34.973982 2097 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:34.974144 2097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:34.974498 2097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:34.978760 2097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "eb981a605fe74ddf8ed92f4d72a1bd62"
format_stamp: "Formatted at 2026-08-12 00:27:34 on dist-test-slave-c12x"
server_key: "ecb53c84f1719b698394a1c1ac08a87c"
server_key_iv: "5be6f89bf942d4a42bcc19172e31e292"
server_key_version: "encryptionkey@0"
I20260812 00:27:34.980225 2097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "eb981a605fe74ddf8ed92f4d72a1bd62"
format_stamp: "Formatted at 2026-08-12 00:27:34 on dist-test-slave-c12x"
server_key: "ecb53c84f1719b698394a1c1ac08a87c"
server_key_iv: "5be6f89bf942d4a42bcc19172e31e292"
server_key_version: "encryptionkey@0"
I20260812 00:27:34.987449 1881 heartbeater.cc:503] Master 127.29.190.190:42589 was elected leader, sending a full tablet report...
I20260812 00:27:34.989630 2097 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.004s
I20260812 00:27:34.993764 2119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:34.995200 2097 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260812 00:27:34.995399 2097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "eb981a605fe74ddf8ed92f4d72a1bd62"
format_stamp: "Formatted at 2026-08-12 00:27:34 on dist-test-slave-c12x"
server_key: "ecb53c84f1719b698394a1c1ac08a87c"
server_key_iv: "5be6f89bf942d4a42bcc19172e31e292"
server_key_version: "encryptionkey@0"
I20260812 00:27:34.995725 2097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:35.013517 2097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:35.018290 2097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:35.018661 2097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:35.019778 2097 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:35.021195 2097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:35.021304 2097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:35.021462 2097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:35.021538 2097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:35.057163 2097 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:42689
I20260812 00:27:35.057260 2280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:42689 every 8 connection(s)
I20260812 00:27:35.058539 2097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:35.067852 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 2097
I20260812 00:27:35.068104 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:35.068570 30458 external_mini_cluster.cc:1428] Setting key c69f16aedb5bb143a9be8beb86228256
Aug 12 00:27:35 dist-test-slave-c12x krb5kdc[1531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494454, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:35.079334 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:35.061233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:51799 (local address 127.29.190.190:42589)
0812 00:27:35.061723 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:35.061727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:35.062697 (+ 970us) server_negotiation.cc:407] Connection header received
0812 00:27:35.064672 (+ 1975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:35.064678 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:35.064790 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:35.064920 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:35.066447 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:35.067242 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:35.069066 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:35.069633 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:35.069770 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:35.073352 (+ 3582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:35.073364 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:35.073367 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:35.073399 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:35.076235 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:35.076969 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:35.076977 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:35.076985 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:35.077108 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:35.077555 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:35.077566 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:35.077568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:35.077834 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:35.078008 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:35.078712 (+ 704us) server_negotiation.cc:299] Negotiation successful
0812 00:27:35.078930 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":248,"threads_started":1}
I20260812 00:27:35.080330 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:35.061800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42589 (local address 127.29.190.131:51799)
0812 00:27:35.062522 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:35.062581 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:35.064385 (+ 1804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:35.065170 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:35.065179 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:35.065692 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:35.066265 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:35.066283 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:35.067408 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:35.067415 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:35.068900 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:35.068913 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:35.069882 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:35.069891 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:35.070141 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:35.070851 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:35.070885 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:35.073147 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:35.076382 (+ 3235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:35.076391 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:35.076409 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:35.076835 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:35.077226 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:35.077231 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:35.077235 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:35.077425 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:35.077972 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:35.077980 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:35.078348 (+ 368us) client_negotiation.cc:769] Sending connection context
0812 00:27:35.078621 (+ 273us) client_negotiation.cc:240] Negotiation successful
0812 00:27:35.079181 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":286,"threads_started":1}
I20260812 00:27:35.081804 2281 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42589
I20260812 00:27:35.082190 2281 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:35.083393 2281 heartbeater.cc:511] Master 127.29.190.190:42589 requested a full tablet report, sending...
I20260812 00:27:35.085336 1600 ts_manager.cc:194] Registered new tserver with Master: eb981a605fe74ddf8ed92f4d72a1bd62 (127.29.190.131:42689)
I20260812 00:27:35.086164 1600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:51799
I20260812 00:27:35.097564 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:27:35.136392 2286 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:35.133647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49418 (local address 127.29.190.190:42589)
0812 00:27:35.133868 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:35.133876 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:35.134298 (+ 422us) server_negotiation.cc:407] Connection header received
0812 00:27:35.134532 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:35.134537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:35.134608 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:35.134724 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:35.136186 (+ 1462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49418: BlockingRecv error: recv got EOF from 127.0.0.1:49418 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 00:27:35.140136 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 1689
W20260812 00:27:35.143133 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 1689: Not authorized: Client connection negotiation failed: client connection to 127.29.190.129:41287: server requires authentication, but client does not have Kerberos credentials available
I20260812 00:27:35.143294 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 1689
I20260812 00:27:35.169513 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 1889
W20260812 00:27:35.172483 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 1889: Not authorized: Client connection negotiation failed: client connection to 127.29.190.130:40339: server requires authentication, but client does not have Kerberos credentials available
I20260812 00:27:35.172698 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 1889
I20260812 00:27:35.198078 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 2097
W20260812 00:27:35.201546 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 2097: Not authorized: Client connection negotiation failed: client connection to 127.29.190.131:42689: server requires authentication, but client does not have Kerberos credentials available
I20260812 00:27:35.201710 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 2097
I20260812 00:27:35.230124 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 1553
I20260812 00:27:35.231653 1645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:35.337395 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 1553
2026-08-12T00:27:35Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4147 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:35 dist-test-slave-c12x krb5kdc[2316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:35 dist-test-slave-c12x krb5kdc[2316](info): set up 2 sockets
Aug 12 00:27:35 dist-test-slave-c12x krb5kdc[2316](info): commencing operation
krb5kdc: starting...
W20260812 00:27:36.674682 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:36 dist-test-slave-c12x krb5kdc[2316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:36.911382 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46437
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:37.260362 2341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:37.260715 2341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:37.260931 2341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:37.268970 2341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:37.269137 2341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:37.269282 2341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:37.269415 2341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:37.269508 2341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:37.280298 2341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:37.281849 2341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:37.283424 2341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:37.297101 2349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:37.297107 2352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:37.297396 2350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:37.297940 2341 server_base.cc:1034] running on GCE node
I20260812 00:27:37.298810 2341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:37.300459 2341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:37.301680 2341 hybrid_clock.cc:648] HybridClock initialized: now 1786494457301633 us; error 34 us; skew 500 ppm
I20260812 00:27:37.302078 2341 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:37 dist-test-slave-c12x krb5kdc[2316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494457, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:37.306326 2341 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:37.308064 2341 webserver.cc:460] Webserver started at http://127.29.190.190:44689/ using document root <none> and password file <none>
I20260812 00:27:37.308794 2341 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:37.308902 2341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:37.309178 2341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:37.312331 2341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "ceede04275954e57afbd6e836ac5117f"
format_stamp: "Formatted at 2026-08-12 00:27:37 on dist-test-slave-c12x"
server_key: "a260602d1c9d85985c39451f8b00fc1d"
server_key_iv: "34b861b877350f978b8dba295935fc0a"
server_key_version: "encryptionkey@0"
I20260812 00:27:37.313124 2341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "ceede04275954e57afbd6e836ac5117f"
format_stamp: "Formatted at 2026-08-12 00:27:37 on dist-test-slave-c12x"
server_key: "a260602d1c9d85985c39451f8b00fc1d"
server_key_iv: "34b861b877350f978b8dba295935fc0a"
server_key_version: "encryptionkey@0"
I20260812 00:27:37.318754 2341 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 00:27:37.322589 2360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:37.324127 2341 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:27:37.324330 2341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "ceede04275954e57afbd6e836ac5117f"
format_stamp: "Formatted at 2026-08-12 00:27:37 on dist-test-slave-c12x"
server_key: "a260602d1c9d85985c39451f8b00fc1d"
server_key_iv: "34b861b877350f978b8dba295935fc0a"
server_key_version: "encryptionkey@0"
I20260812 00:27:37.324533 2341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:37.344581 2341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:37.349296 2341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:37.349613 2341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:37.368772 2341 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46437
I20260812 00:27:37.368818 2441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46437 every 8 connection(s)
I20260812 00:27:37.370345 2341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:37.374347 2442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:37.375381 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 2341
I20260812 00:27:37.375675 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:37.376523 30458 external_mini_cluster.cc:1428] Setting key 884a4a0736b7afb276136f35a12ad637
I20260812 00:27:37.389945 2442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f: Bootstrap starting.
Aug 12 00:27:37 dist-test-slave-c12x krb5kdc[2316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:37.393296 2442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:37.394735 2442 log.cc:824] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:37.398172 2442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f: No bootstrap required, opened a new log
I20260812 00:27:37.402055 2445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:37.378648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59882 (local address 127.29.190.190:46437)
0812 00:27:37.379518 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:37.379535 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:37.379603 (+ 68us) server_negotiation.cc:407] Connection header received
0812 00:27:37.381829 (+ 2226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:37.381865 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:37.382443 (+ 578us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:37.382930 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:37.384514 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:37.386626 (+ 2112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:37.388026 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:37.389120 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:37.389306 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:37.393308 (+ 4002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:37.393324 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:37.393343 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:37.393394 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:37.397334 (+ 3940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:37.398040 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:37.398048 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:37.398056 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:37.398281 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:37.398703 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:37.398708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:37.398711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:37.399476 (+ 765us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:37.399791 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:37.400166 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 00:27:37.400656 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":341,"threads_started":1}
I20260812 00:27:37.406211 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:27:37.407912 2442 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceede04275954e57afbd6e836ac5117f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46437 } }
I20260812 00:27:37.408305 2442 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:37.408416 2442 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceede04275954e57afbd6e836ac5117f, State: Initialized, Role: FOLLOWER
I20260812 00:27:37.409025 2442 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceede04275954e57afbd6e836ac5117f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46437 } }
I20260812 00:27:37.409312 2442 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:37.409463 2442 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:37.409664 2442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:37.411998 2442 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceede04275954e57afbd6e836ac5117f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46437 } }
I20260812 00:27:37.412533 2442 leader_election.cc:302] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceede04275954e57afbd6e836ac5117f; no voters:
I20260812 00:27:37.413149 2442 leader_election.cc:288] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:37.413318 2448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:37.414634 2448 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [term 1 LEADER]: Becoming Leader. State: Replica: ceede04275954e57afbd6e836ac5117f, State: Running, Role: LEADER
I20260812 00:27:37.415174 2448 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceede04275954e57afbd6e836ac5117f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46437 } }
I20260812 00:27:37.415859 2442 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:37.418022 2450 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceede04275954e57afbd6e836ac5117f. Latest consensus state: current_term: 1 leader_uuid: "ceede04275954e57afbd6e836ac5117f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceede04275954e57afbd6e836ac5117f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46437 } } }
I20260812 00:27:37.418447 2450 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:37.419068 2449 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceede04275954e57afbd6e836ac5117f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceede04275954e57afbd6e836ac5117f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46437 } } }
I20260812 00:27:37.419369 2449 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:37.428740 2455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:37.435642 2455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:37.463276 2455 catalog_manager.cc:1347] Generated new cluster ID: ad7e39c28a6449b38b8b71246c3f4ae8
I20260812 00:27:37.463662 2455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:37.490408 2455 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:37.492909 2455 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:37.504685 2455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceede04275954e57afbd6e836ac5117f: Generated new TSK 0
I20260812 00:27:37.505769 2455 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:27:37.507480 2445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:37.497035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59894 (local address 127.29.190.190:46437)
0812 00:27:37.497213 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:37.497220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:37.498336 (+ 1116us) server_negotiation.cc:407] Connection header received
0812 00:27:37.498543 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:37.498549 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:37.498635 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:37.498745 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:37.500150 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:37.501437 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:37.503428 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:37.504089 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:37.504222 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:37.505564 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:37.505571 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:37.505575 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:37.506397 (+ 822us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:37.506508 (+ 111us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:37.506550 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:37.506678 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:37.506851 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 00:27:37.506974 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":38}
I20260812 00:27:37.515945 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 2341
I20260812 00:27:37.517370 2436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:37.612670 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 2341
2026-08-12T00:27:37Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2275 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:37 dist-test-slave-c12x krb5kdc[2489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:37 dist-test-slave-c12x krb5kdc[2489](info): set up 2 sockets
Aug 12 00:27:37 dist-test-slave-c12x krb5kdc[2489](info): commencing operation
krb5kdc: starting...
W20260812 00:27:38.947134 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.001s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:39 dist-test-slave-c12x krb5kdc[2489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:39.188349 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46105
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46105
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:39.548941 2510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:39.549263 2510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:39.549356 2510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:39.556945 2510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:39.557080 2510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:39.557128 2510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:39.557179 2510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:39.557226 2510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:39.569839 2510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:39.571300 2510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:39.572785 2510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:39.586091 2527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:39.586110 2522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:39.586182 2520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:39.589411 2510 server_base.cc:1034] running on GCE node
I20260812 00:27:39.590394 2510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:39.592156 2510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:39.593420 2510 hybrid_clock.cc:648] HybridClock initialized: now 1786494459593357 us; error 53 us; skew 500 ppm
I20260812 00:27:39.593837 2510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:39 dist-test-slave-c12x krb5kdc[2489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494459, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:39.601421 2510 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:39.603406 2510 webserver.cc:460] Webserver started at http://127.29.190.190:46691/ using document root <none> and password file <none>
I20260812 00:27:39.604384 2510 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:39.604559 2510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:39.604907 2510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:39.608273 2510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "c3721440a1c94c9eb9617b53007440df"
format_stamp: "Formatted at 2026-08-12 00:27:39 on dist-test-slave-c12x"
server_key: "4429524e4fdc7f203573a0679a2ade56"
server_key_iv: "9127705b1df618dc64578f9867e430d6"
server_key_version: "encryptionkey@0"
I20260812 00:27:39.609141 2510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "c3721440a1c94c9eb9617b53007440df"
format_stamp: "Formatted at 2026-08-12 00:27:39 on dist-test-slave-c12x"
server_key: "4429524e4fdc7f203573a0679a2ade56"
server_key_iv: "9127705b1df618dc64578f9867e430d6"
server_key_version: "encryptionkey@0"
I20260812 00:27:39.615039 2510 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 00:27:39.620679 2535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:39.624111 2510 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.003s
I20260812 00:27:39.624333 2510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "c3721440a1c94c9eb9617b53007440df"
format_stamp: "Formatted at 2026-08-12 00:27:39 on dist-test-slave-c12x"
server_key: "4429524e4fdc7f203573a0679a2ade56"
server_key_iv: "9127705b1df618dc64578f9867e430d6"
server_key_version: "encryptionkey@0"
I20260812 00:27:39.624642 2510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:39.637993 2510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:39.642935 2510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:39.643215 2510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:39.662859 2510 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46105
I20260812 00:27:39.662951 2618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46105 every 8 connection(s)
I20260812 00:27:39.664484 2510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:39.668417 2620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:39.674026 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 2510
I20260812 00:27:39.674263 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:39.674964 30458 external_mini_cluster.cc:1428] Setting key 6e03786465f6550a1f598a4db000f47c
I20260812 00:27:39.680192 2620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df: Bootstrap starting.
I20260812 00:27:39.684231 2620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:39.685360 2620 log.cc:824] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:39.689390 2620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df: No bootstrap required, opened a new log
Aug 12 00:27:39 dist-test-slave-c12x krb5kdc[2489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:39.698786 2620 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3721440a1c94c9eb9617b53007440df" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46105 } }
I20260812 00:27:39.699268 2620 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:39.699489 2620 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3721440a1c94c9eb9617b53007440df, State: Initialized, Role: FOLLOWER
I20260812 00:27:39.700275 2620 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3721440a1c94c9eb9617b53007440df" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46105 } }
I20260812 00:27:39.700551 2620 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:39.700702 2620 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:39.700917 2620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:39.701171 2624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:39.677221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52416 (local address 127.29.190.190:46105)
0812 00:27:39.678183 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:39.678195 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:39.678238 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:27:39.680005 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:39.680029 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:39.680497 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:39.680836 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:39.682805 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:39.684237 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:39.685571 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:39.686866 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:39.687052 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:39.692034 (+ 4982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:39.692044 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:39.692064 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:39.692106 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:39.696100 (+ 3994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:39.696948 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:39.696956 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:39.696964 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:39.697167 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:39.697588 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:39.697594 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:39.697603 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:39.698219 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:39.698562 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:39.699047 (+ 485us) server_negotiation.cc:299] Negotiation successful
0812 00:27:39.699730 (+ 683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":451,"threads_started":1}
I20260812 00:27:39.703549 2620 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3721440a1c94c9eb9617b53007440df" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46105 } }
I20260812 00:27:39.704093 2620 leader_election.cc:302] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3721440a1c94c9eb9617b53007440df; no voters:
I20260812 00:27:39.704830 2620 leader_election.cc:288] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:39.705004 2626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:39.705848 2626 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [term 1 LEADER]: Becoming Leader. State: Replica: c3721440a1c94c9eb9617b53007440df, State: Running, Role: LEADER
I20260812 00:27:39.706460 2626 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3721440a1c94c9eb9617b53007440df" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46105 } }
I20260812 00:27:39.707288 2620 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:39.710456 2628 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3721440a1c94c9eb9617b53007440df. Latest consensus state: current_term: 1 leader_uuid: "c3721440a1c94c9eb9617b53007440df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3721440a1c94c9eb9617b53007440df" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46105 } } }
I20260812 00:27:39.711040 2628 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:39.710881 2627 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3721440a1c94c9eb9617b53007440df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3721440a1c94c9eb9617b53007440df" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46105 } } }
I20260812 00:27:39.711284 2627 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:39.712070 2642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:39.719635 2642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:39.730906 2642 catalog_manager.cc:1347] Generated new cluster ID: f03f96cf05a04df88b213b85b7a8fa72
I20260812 00:27:39.731119 2642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:39.744813 2642 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:39.746304 2642 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:39.763463 2642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3721440a1c94c9eb9617b53007440df: Generated new TSK 0
I20260812 00:27:39.764444 2642 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:27:39.836089 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46105
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:40.208623 2663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:40.208981 2663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:40.209170 2663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:40.217180 2663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:40.217347 2663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:40.217543 2663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:40.227934 2663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:40.229458 2663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:40.231009 2663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:40.245323 2669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:40.245347 2673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:40.245277 2670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:40.246316 2663 server_base.cc:1034] running on GCE node
I20260812 00:27:40.246992 2663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:40.248143 2663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:40.249408 2663 hybrid_clock.cc:648] HybridClock initialized: now 1786494460249347 us; error 42 us; skew 500 ppm
I20260812 00:27:40.249765 2663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:40 dist-test-slave-c12x krb5kdc[2489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494460, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:40.253342 2663 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:27:40.254912 2663 webserver.cc:460] Webserver started at http://127.29.190.129:39203/ using document root <none> and password file <none>
I20260812 00:27:40.255770 2663 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:40.255929 2663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:40.256264 2663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:40.259336 2663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "770dd9ddb58e44b489ef0f4eaa4cf35b"
format_stamp: "Formatted at 2026-08-12 00:27:40 on dist-test-slave-c12x"
server_key: "81259b85cf90a18fd224f6292e4f542c"
server_key_iv: "5c3fb00a9bcfb6b7f8a695aba503bf81"
server_key_version: "encryptionkey@0"
I20260812 00:27:40.260277 2663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "770dd9ddb58e44b489ef0f4eaa4cf35b"
format_stamp: "Formatted at 2026-08-12 00:27:40 on dist-test-slave-c12x"
server_key: "81259b85cf90a18fd224f6292e4f542c"
server_key_iv: "5c3fb00a9bcfb6b7f8a695aba503bf81"
server_key_version: "encryptionkey@0"
I20260812 00:27:40.265787 2663 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:27:40.269572 2684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:40.271155 2663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:27:40.271417 2663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "770dd9ddb58e44b489ef0f4eaa4cf35b"
format_stamp: "Formatted at 2026-08-12 00:27:40 on dist-test-slave-c12x"
server_key: "81259b85cf90a18fd224f6292e4f542c"
server_key_iv: "5c3fb00a9bcfb6b7f8a695aba503bf81"
server_key_version: "encryptionkey@0"
I20260812 00:27:40.271751 2663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:40.295125 2663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:40.300874 2663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:40.301262 2663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:40.302454 2663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:40.304318 2663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:40.304418 2663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:40.304566 2663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:40.304637 2663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:40.339735 2663 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:37709
I20260812 00:27:40.339771 2864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:37709 every 8 connection(s)
I20260812 00:27:40.341089 2663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:40.343492 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 2663
I20260812 00:27:40.343729 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:40.344607 30458 external_mini_cluster.cc:1428] Setting key ab0fb1afe5ba8ba5f80edc0304657e06
Aug 12 00:27:40 dist-test-slave-c12x krb5kdc[2489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494460, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:40.365396 2870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:40.345270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:49211 (local address 127.29.190.190:46105)
0812 00:27:40.345843 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:40.345849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:40.345872 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:27:40.347999 (+ 2127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:40.348008 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:40.348103 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:40.348231 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:40.349747 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:40.350929 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:40.352634 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:40.353383 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:40.353531 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:40.357774 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:40.357785 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:40.357793 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:40.357846 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:40.361637 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:40.362463 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:40.362472 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:40.362479 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:40.362639 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:40.363101 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:40.363109 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:40.363116 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:40.363550 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:40.363702 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:40.364591 (+ 889us) server_negotiation.cc:299] Negotiation successful
0812 00:27:40.364871 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":324,"threads_started":1}
I20260812 00:27:40.366019 2869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:40.344589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46105 (local address 127.29.190.129:49211)
0812 00:27:40.345614 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:40.345668 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:40.347705 (+ 2037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:40.348440 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:40.348448 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:40.348960 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:40.349563 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:40.349582 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:40.351110 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:40.351114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:40.352472 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:40.352485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:40.353617 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:40.353622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:40.353822 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:40.354650 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:40.354693 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:40.357504 (+ 2811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:40.361804 (+ 4300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:40.361811 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:40.361826 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:40.362313 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:40.362754 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:40.362757 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:40.362760 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:40.362950 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:40.363688 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:40.363694 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:40.364092 (+ 398us) client_negotiation.cc:769] Sending connection context
0812 00:27:40.364394 (+ 302us) client_negotiation.cc:240] Negotiation successful
0812 00:27:40.364808 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":412,"threads_started":1}
I20260812 00:27:40.367756 2865 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46105
I20260812 00:27:40.368139 2865 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
I20260812 00:27:40.369155 2865 heartbeater.cc:511] Master 127.29.190.190:46105 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
I20260812 00:27:40.372018 2560 ts_manager.cc:194] Registered new tserver with Master: 770dd9ddb58e44b489ef0f4eaa4cf35b (127.29.190.129:37709)
I20260812 00:27:40.373556 2560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:49211
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:27:40.399639 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46105
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:40.753464 2880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:40.753777 2880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:40.753878 2880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:40.761519 2880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:40.761665 2880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:40.761786 2880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:40.772323 2880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:40.773711 2880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:40.775048 2880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:40.789567 2891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:40.789697 2892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:40.789881 2896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:40.791258 2880 server_base.cc:1034] running on GCE node
I20260812 00:27:40.792001 2880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:40.793129 2880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:40.794363 2880 hybrid_clock.cc:648] HybridClock initialized: now 1786494460794287 us; error 64 us; skew 500 ppm
I20260812 00:27:40.794759 2880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:40 dist-test-slave-c12x krb5kdc[2489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494460, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:40.798382 2880 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:27:40.800097 2880 webserver.cc:460] Webserver started at http://127.29.190.130:33153/ using document root <none> and password file <none>
I20260812 00:27:40.800863 2880 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:40.800978 2880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:40.801273 2880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:40.804625 2880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "de6763a7ffda4a188a6cc6b4fc982214"
format_stamp: "Formatted at 2026-08-12 00:27:40 on dist-test-slave-c12x"
server_key: "9f9c0d2bcdfacffda5bcca42fdba327a"
server_key_iv: "361055e9ac4e8041e3d08cffc472240c"
server_key_version: "encryptionkey@0"
I20260812 00:27:40.805459 2880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "de6763a7ffda4a188a6cc6b4fc982214"
format_stamp: "Formatted at 2026-08-12 00:27:40 on dist-test-slave-c12x"
server_key: "9f9c0d2bcdfacffda5bcca42fdba327a"
server_key_iv: "361055e9ac4e8041e3d08cffc472240c"
server_key_version: "encryptionkey@0"
I20260812 00:27:40.811940 2880 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:27:40.815974 2904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:40.817706 2880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:27:40.817934 2880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "de6763a7ffda4a188a6cc6b4fc982214"
format_stamp: "Formatted at 2026-08-12 00:27:40 on dist-test-slave-c12x"
server_key: "9f9c0d2bcdfacffda5bcca42fdba327a"
server_key_iv: "361055e9ac4e8041e3d08cffc472240c"
server_key_version: "encryptionkey@0"
I20260812 00:27:40.818221 2880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:40.841065 2880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:40.845985 2880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:40.846323 2880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:40.847653 2880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:40.849267 2880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:40.849382 2880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:40.849552 2880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:40.849633 2880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:40.888069 2880 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:33377
I20260812 00:27:40.888114 3077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:33377 every 8 connection(s)
I20260812 00:27:40.889524 2880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:40.894618 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 2880
I20260812 00:27:40.894824 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:40.895303 30458 external_mini_cluster.cc:1428] Setting key b5b62701e7d0e5d78f96e068d7901850
Aug 12 00:27:40 dist-test-slave-c12x krb5kdc[2489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494460, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:40.913993 3080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:40.892533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:59747 (local address 127.29.190.190:46105)
0812 00:27:40.893074 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:40.893081 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:40.894120 (+ 1039us) server_negotiation.cc:407] Connection header received
0812 00:27:40.896450 (+ 2330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:40.896458 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:40.896564 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:40.896695 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:40.898555 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:40.899385 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:40.901382 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:40.901868 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:40.902012 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:40.906276 (+ 4264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:40.906282 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:40.906286 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:40.906327 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:40.909895 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:40.911125 (+ 1230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:40.911133 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:40.911137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:40.911295 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:40.911854 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:40.911858 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:40.911860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:40.912163 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:40.912332 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:40.913171 (+ 839us) server_negotiation.cc:299] Negotiation successful
0812 00:27:40.913424 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":253,"threads_started":1}
I20260812 00:27:40.915102 3082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:40.893090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46105 (local address 127.29.190.130:59747)
0812 00:27:40.893928 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:40.893973 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:40.896061 (+ 2088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:40.896952 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:40.896962 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:40.897703 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:40.898338 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:40.898358 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:40.899622 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:40.899627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:40.901196 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:40.901210 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:40.902137 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:40.902145 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:40.902398 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:40.903270 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:40.903303 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:40.905968 (+ 2665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:40.910341 (+ 4373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:40.910358 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:40.910374 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:40.910969 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:40.911424 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:40.911429 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:40.911456 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:40.911679 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:40.912302 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:40.912311 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:40.912749 (+ 438us) client_negotiation.cc:769] Sending connection context
0812 00:27:40.913076 (+ 327us) client_negotiation.cc:240] Negotiation successful
0812 00:27:40.913824 (+ 748us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":336,"threads_started":1}
I20260812 00:27:40.917044 3078 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46105
I20260812 00:27:40.917433 3078 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
I20260812 00:27:40.918342 3078 heartbeater.cc:511] Master 127.29.190.190:46105 requested a full tablet report, sending...
I20260812 00:27:40.920189 2560 ts_manager.cc:194] Registered new tserver with Master: de6763a7ffda4a188a6cc6b4fc982214 (127.29.190.130:33377)
I20260812 00:27:40.921109 2560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:59747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:27:40.951594 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46105
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:41.299273 3086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:41.299600 3086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:41.299762 3086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:41.307173 3086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:41.307293 3086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:41.307495 3086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:41.317785 3086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:41.319145 3086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:41.320482 3086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:41.334388 3103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:41.334321 3108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:41.334410 3104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:41.335347 3086 server_base.cc:1034] running on GCE node
I20260812 00:27:41.336087 3086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:41.337116 3086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:41.338323 3086 hybrid_clock.cc:648] HybridClock initialized: now 1786494461338252 us; error 61 us; skew 500 ppm
I20260812 00:27:41.338672 3086 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[2489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494461, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:41.342003 3086 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:27:41.343683 3086 webserver.cc:460] Webserver started at http://127.29.190.131:38819/ using document root <none> and password file <none>
I20260812 00:27:41.344379 3086 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:41.344521 3086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:41.344843 3086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:41.347932 3086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "896101e2f82d4dc29706908af46e0c70"
format_stamp: "Formatted at 2026-08-12 00:27:41 on dist-test-slave-c12x"
server_key: "6fd874f9ce531637a7d9c859f88e58bc"
server_key_iv: "26728e262f8cdea188b9d7cab4097bc0"
server_key_version: "encryptionkey@0"
I20260812 00:27:41.348726 3086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "896101e2f82d4dc29706908af46e0c70"
format_stamp: "Formatted at 2026-08-12 00:27:41 on dist-test-slave-c12x"
server_key: "6fd874f9ce531637a7d9c859f88e58bc"
server_key_iv: "26728e262f8cdea188b9d7cab4097bc0"
server_key_version: "encryptionkey@0"
I20260812 00:27:41.353765 3086 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:27:41.357340 3115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:41.358649 3086 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:27:41.358815 3086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "896101e2f82d4dc29706908af46e0c70"
format_stamp: "Formatted at 2026-08-12 00:27:41 on dist-test-slave-c12x"
server_key: "6fd874f9ce531637a7d9c859f88e58bc"
server_key_iv: "26728e262f8cdea188b9d7cab4097bc0"
server_key_version: "encryptionkey@0"
I20260812 00:27:41.359025 3086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:41.377048 2865 heartbeater.cc:503] Master 127.29.190.190:46105 was elected leader, sending a full tablet report...
I20260812 00:27:41.378728 3086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:41.383311 3086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:41.383693 3086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:41.384722 3086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:41.386075 3086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:41.386150 3086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:41.386238 3086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:41.386283 3086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:41.421836 3086 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:33497
I20260812 00:27:41.421882 3282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:33497 every 8 connection(s)
I20260812 00:27:41.423285 3086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:41.425777 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 3086
I20260812 00:27:41.425976 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:41.426560 30458 external_mini_cluster.cc:1428] Setting key 45f25ed3e4793c1d8df3e273d2a47296
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[2489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494461, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:41.445118 3285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:41.426076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:57815 (local address 127.29.190.190:46105)
0812 00:27:41.426636 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:41.426643 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:41.427760 (+ 1117us) server_negotiation.cc:407] Connection header received
0812 00:27:41.430150 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:41.430157 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:41.430248 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:41.430364 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:41.431925 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.432815 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.434347 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.434781 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.434882 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:41.438428 (+ 3546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:41.438434 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:41.438437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:41.438487 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:41.441862 (+ 3375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.442960 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.442964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.442967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.443094 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.443605 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.443608 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.443610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.443886 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:41.443995 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:41.444687 (+ 692us) server_negotiation.cc:299] Negotiation successful
0812 00:27:41.444853 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":254,"threads_started":1}
I20260812 00:27:41.446228 3287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:41.426720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46105 (local address 127.29.190.131:57815)
0812 00:27:41.427576 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:41.427634 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:41.429773 (+ 2139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:41.430578 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:41.430586 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:41.431104 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:41.431759 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:41.431778 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.432970 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.432973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:41.434215 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:41.434227 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.434975 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.434980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:41.435170 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:41.435927 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:41.435955 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:41.438178 (+ 2223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:41.442077 (+ 3899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:41.442090 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:41.442112 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:41.442776 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:41.443217 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:41.443220 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:41.443222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:41.443415 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:41.443999 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:41.444005 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:41.444342 (+ 337us) client_negotiation.cc:769] Sending connection context
0812 00:27:41.444574 (+ 232us) client_negotiation.cc:240] Negotiation successful
0812 00:27:41.444972 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":321,"threads_started":1}
I20260812 00:27:41.447695 3283 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46105
I20260812 00:27:41.448015 3283 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:41.448774 3283 heartbeater.cc:511] Master 127.29.190.190:46105 requested a full tablet report, sending...
I20260812 00:27:41.450218 2560 ts_manager.cc:194] Registered new tserver with Master: 896101e2f82d4dc29706908af46e0c70 (127.29.190.131:33497)
I20260812 00:27:41.451025 2560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:57815
I20260812 00:27:41.454937 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[2489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494461, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[2489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494461, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:41.512032 3285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:41.495606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52430 (local address 127.29.190.190:46105)
0812 00:27:41.495891 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:41.495901 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:41.496313 (+ 412us) server_negotiation.cc:407] Connection header received
0812 00:27:41.496596 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:41.496601 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:41.496694 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:41.496822 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:41.498391 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.499228 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.500726 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.501191 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.501357 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:41.505860 (+ 4503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:41.505866 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:41.505870 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:41.505914 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:41.508770 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.509512 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.509516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.509518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.509653 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.510268 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.510273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.510275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.510672 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:41.510976 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:41.511361 (+ 385us) server_negotiation.cc:299] Negotiation successful
0812 00:27:41.511675 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
W20260812 00:27:41.512696 2560 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52430
I20260812 00:27:41.514771 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 2663
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[2489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494461, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:41.533463 3301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:41.516034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56034 (local address 127.29.190.129:37709)
0812 00:27:41.516732 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:41.516741 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:41.516768 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:27:41.516828 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:41.516835 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:41.517076 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:41.517218 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:41.518576 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.519831 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.521119 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.521730 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.521835 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:41.526535 (+ 4700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:41.526550 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:41.526566 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:41.526607 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:41.530174 (+ 3567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.531190 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.531198 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.531201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.531359 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.531855 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.531859 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.531861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.532248 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:41.532492 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:41.532791 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 00:27:41.533022 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":378,"threads_started":1}
W20260812 00:27:41.534848 2855 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56034
W20260812 00:27:41.536248 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 2663: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:41.536532 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 2663
I20260812 00:27:41.564975 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 2880
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[2489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494461, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:27:41.586372 3303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:41.566164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49822 (local address 127.29.190.130:33377)
0812 00:27:41.566898 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:41.566906 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:41.566937 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:27:41.567012 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:41.567019 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:41.567240 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:41.567394 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:41.568791 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.569994 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.572259 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.573497 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.573659 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:41.579151 (+ 5492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:41.579167 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:41.579184 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:41.579229 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:41.582829 (+ 3600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.583740 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.583750 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.583753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.583906 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.584428 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.584433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.584435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.584887 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:41.585270 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:41.585677 (+ 407us) server_negotiation.cc:299] Negotiation successful
0812 00:27:41.585984 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":419,"threads_started":1}
W20260812 00:27:41.587860 3071 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49822
W20260812 00:27:41.589089 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 2880: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:41.589252 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 2880
I20260812 00:27:41.618374 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 3086
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[2489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494461, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:27:41.637909 3304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:41.619955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55616 (local address 127.29.190.131:33497)
0812 00:27:41.620931 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:41.620943 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:41.620986 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:27:41.621082 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:41.621093 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:41.621402 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:41.621614 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:41.623280 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.624589 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.625923 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:41.626660 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:41.626765 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:41.631692 (+ 4927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:41.631709 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:41.631728 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:41.631778 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:41.634783 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.635795 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.635803 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.635806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.635952 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:41.636340 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:41.636344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:41.636346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:41.636746 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:41.636982 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:41.637269 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 00:27:41.637491 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":528,"threads_started":1}
W20260812 00:27:41.639358 3278 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55616
W20260812 00:27:41.640623 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 3086: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:27:41.640843 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 3086
I20260812 00:27:41.669028 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 2510
I20260812 00:27:41.670387 2610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:41.778664 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 2510
2026-08-12T00:27:41Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4170 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[3309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[3309](info): set up 2 sockets
Aug 12 00:27:41 dist-test-slave-c12x krb5kdc[3309](info): commencing operation
krb5kdc: starting...
W20260812 00:27:43.102355 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:43 dist-test-slave-c12x krb5kdc[3309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:43.347556 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:33227
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:33227
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:43.701282 3327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:43.701701 3327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:43.701882 3327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:43.709379 3327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:43.709566 3327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:43.709686 3327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:43.709795 3327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:43.709887 3327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:43.720249 3327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:33227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:33227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:43.721781 3327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:43.723204 3327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:43.737022 3339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:43.737197 3332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:43.737195 3334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:43.738168 3327 server_base.cc:1034] running on GCE node
I20260812 00:27:43.739591 3327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:43.742353 3327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:43.743669 3327 hybrid_clock.cc:648] HybridClock initialized: now 1786494463743546 us; error 72 us; skew 500 ppm
I20260812 00:27:43.744161 3327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:43 dist-test-slave-c12x krb5kdc[3309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494463, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:43.747905 3327 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:43.749835 3327 webserver.cc:460] Webserver started at http://127.29.190.190:42321/ using document root <none> and password file <none>
I20260812 00:27:43.750841 3327 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:43.751017 3327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:43.751371 3327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:43.754779 3327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "e4cc15cceaa047cbbf17546c86ce908b"
format_stamp: "Formatted at 2026-08-12 00:27:43 on dist-test-slave-c12x"
server_key: "4954ae8c87daca7460450971cc56c29d"
server_key_iv: "49cfad72e2764631890c4db51c2536ab"
server_key_version: "encryptionkey@0"
I20260812 00:27:43.755733 3327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "e4cc15cceaa047cbbf17546c86ce908b"
format_stamp: "Formatted at 2026-08-12 00:27:43 on dist-test-slave-c12x"
server_key: "4954ae8c87daca7460450971cc56c29d"
server_key_iv: "49cfad72e2764631890c4db51c2536ab"
server_key_version: "encryptionkey@0"
I20260812 00:27:43.761346 3327 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 00:27:43.765213 3350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:43.766736 3327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:27:43.766947 3327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "e4cc15cceaa047cbbf17546c86ce908b"
format_stamp: "Formatted at 2026-08-12 00:27:43 on dist-test-slave-c12x"
server_key: "4954ae8c87daca7460450971cc56c29d"
server_key_iv: "49cfad72e2764631890c4db51c2536ab"
server_key_version: "encryptionkey@0"
I20260812 00:27:43.767179 3327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:43.782351 3327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:43.786720 3327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:43.787045 3327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:43.808254 3327 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:33227
I20260812 00:27:43.808293 3432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:33227 every 8 connection(s)
I20260812 00:27:43.809831 3327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:43.811668 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 3327
I20260812 00:27:43.811972 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:43.812985 30458 external_mini_cluster.cc:1428] Setting key 637e84a6adf0e05e4a6f235be67ce8b7
I20260812 00:27:43.815876 3433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 00:27:43 dist-test-slave-c12x krb5kdc[3309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:43.829131 3433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b: Bootstrap starting.
I20260812 00:27:43.833392 3433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:43.834867 3433 log.cc:824] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:43.838254 3436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:43.815557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45044 (local address 127.29.190.190:33227)
0812 00:27:43.816503 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:43.816517 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:43.816562 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:27:43.818310 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:43.818334 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:43.818750 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:43.819194 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:43.820752 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:43.822146 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:43.823466 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:43.824169 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:43.824380 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:43.829272 (+ 4892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:43.829287 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:43.829314 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:43.829365 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:43.833122 (+ 3757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:43.834129 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:43.834137 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:43.834144 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:43.834331 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:43.834811 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:43.834815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:43.834817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:43.835584 (+ 767us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:43.835922 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:43.836375 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 00:27:43.836866 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":452,"threads_started":1}
I20260812 00:27:43.838666 3433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b: No bootstrap required, opened a new log
I20260812 00:27:43.847002 3433 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cc15cceaa047cbbf17546c86ce908b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33227 } }
I20260812 00:27:43.847484 3433 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:43.847626 3433 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cc15cceaa047cbbf17546c86ce908b, State: Initialized, Role: FOLLOWER
I20260812 00:27:43.848284 3433 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cc15cceaa047cbbf17546c86ce908b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33227 } }
I20260812 00:27:43.848528 3433 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:43.848682 3433 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:43.848888 3433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:43.851109 3433 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cc15cceaa047cbbf17546c86ce908b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33227 } }
I20260812 00:27:43.851745 3433 leader_election.cc:302] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4cc15cceaa047cbbf17546c86ce908b; no voters:
I20260812 00:27:43.852356 3433 leader_election.cc:288] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:43.852512 3438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:43.853745 3438 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [term 1 LEADER]: Becoming Leader. State: Replica: e4cc15cceaa047cbbf17546c86ce908b, State: Running, Role: LEADER
I20260812 00:27:43.854398 3438 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cc15cceaa047cbbf17546c86ce908b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33227 } }
I20260812 00:27:43.854754 3433 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:43.857816 3439 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4cc15cceaa047cbbf17546c86ce908b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cc15cceaa047cbbf17546c86ce908b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33227 } } }
I20260812 00:27:43.858278 3439 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:43.857851 3440 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4cc15cceaa047cbbf17546c86ce908b. Latest consensus state: current_term: 1 leader_uuid: "e4cc15cceaa047cbbf17546c86ce908b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4cc15cceaa047cbbf17546c86ce908b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33227 } } }
I20260812 00:27:43.858747 3440 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:43.862097 3447 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:43.867872 3447 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:43.877794 3447 catalog_manager.cc:1347] Generated new cluster ID: 69f115b5abe84da19fc64f68bf9618b0
I20260812 00:27:43.877941 3447 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:43.900228 3447 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:43.901657 3447 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:43.908282 3447 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4cc15cceaa047cbbf17546c86ce908b: Generated new TSK 0
I20260812 00:27:43.909431 3447 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:27:43.977401 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33227
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:44.337527 3468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:44.338110 3468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:44.338397 3468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:44.346555 3468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:44.346709 3468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:44.346946 3468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:44.358803 3468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:44.360476 3468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:44.362277 3468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:44.378629 3477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:44.378664 3475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:44.378700 3474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:44.379249 3468 server_base.cc:1034] running on GCE node
I20260812 00:27:44.380664 3468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:44.381842 3468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:44.383219 3468 hybrid_clock.cc:648] HybridClock initialized: now 1786494464383140 us; error 41 us; skew 500 ppm
I20260812 00:27:44.383822 3468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:44 dist-test-slave-c12x krb5kdc[3309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494464, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:44.387758 3468 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:27:44.389493 3468 webserver.cc:460] Webserver started at http://127.29.190.129:44479/ using document root <none> and password file <none>
I20260812 00:27:44.390249 3468 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:44.390457 3468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:44.390785 3468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:44.393971 3468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "4cfe86585f9e4dbaa8cfdf29d7098ba2"
format_stamp: "Formatted at 2026-08-12 00:27:44 on dist-test-slave-c12x"
server_key: "2c7726b0f3c833338be5ec4990cb2b49"
server_key_iv: "eb79f7400d1a755c2e3ee50acae10128"
server_key_version: "encryptionkey@0"
I20260812 00:27:44.394817 3468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "4cfe86585f9e4dbaa8cfdf29d7098ba2"
format_stamp: "Formatted at 2026-08-12 00:27:44 on dist-test-slave-c12x"
server_key: "2c7726b0f3c833338be5ec4990cb2b49"
server_key_iv: "eb79f7400d1a755c2e3ee50acae10128"
server_key_version: "encryptionkey@0"
I20260812 00:27:44.400329 3468 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260812 00:27:44.404312 3486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:44.405961 3468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:27:44.406184 3468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "4cfe86585f9e4dbaa8cfdf29d7098ba2"
format_stamp: "Formatted at 2026-08-12 00:27:44 on dist-test-slave-c12x"
server_key: "2c7726b0f3c833338be5ec4990cb2b49"
server_key_iv: "eb79f7400d1a755c2e3ee50acae10128"
server_key_version: "encryptionkey@0"
I20260812 00:27:44.406435 3468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:44.435683 3468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:44.440943 3468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:44.441334 3468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:44.442554 3468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:44.444291 3468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:44.444412 3468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:44.444593 3468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:44.444679 3468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:44.485682 3468 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:33801
I20260812 00:27:44.485786 3649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:33801 every 8 connection(s)
I20260812 00:27:44.487222 3468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:44.494246 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 3468
I20260812 00:27:44.494496 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:44.495414 30458 external_mini_cluster.cc:1428] Setting key 065d0c9ad9e21919a1cfc663bae10163
Aug 12 00:27:44 dist-test-slave-c12x krb5kdc[3309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494464, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:44.516443 3653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:44.490248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:38213 (local address 127.29.190.190:33227)
0812 00:27:44.490786 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:44.490793 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:44.492268 (+ 1475us) server_negotiation.cc:407] Connection header received
0812 00:27:44.495567 (+ 3299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:44.495574 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:44.495666 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:44.495773 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:44.497992 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:44.498795 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:44.501807 (+ 3012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:44.502240 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:44.502358 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:44.507632 (+ 5274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:44.507640 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:44.507645 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:44.507701 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:44.512213 (+ 4512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:44.513146 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:44.513156 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:44.513163 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:44.513378 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:44.513935 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:44.513943 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:44.513950 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:44.514409 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:44.514590 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:44.515544 (+ 954us) server_negotiation.cc:299] Negotiation successful
0812 00:27:44.515851 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":252,"threads_started":1}
I20260812 00:27:44.517143 3654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:44.490894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:33227 (local address 127.29.190.129:38213)
0812 00:27:44.491996 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:44.492087 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:44.495063 (+ 2976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:44.496139 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:44.496156 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:44.496912 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:44.497740 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:44.497763 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:44.498997 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:44.499006 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:44.501602 (+ 2596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:44.501623 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:44.502516 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:44.502527 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:44.502930 (+ 403us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:44.503917 (+ 987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:44.503957 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:44.507284 (+ 3327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:44.512414 (+ 5130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:44.512430 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:44.512445 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:44.512974 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:44.513552 (+ 578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:44.513556 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:44.513559 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:44.513780 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:44.514613 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:44.514621 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:44.515006 (+ 385us) client_negotiation.cc:769] Sending connection context
0812 00:27:44.515305 (+ 299us) client_negotiation.cc:240] Negotiation successful
0812 00:27:44.515858 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":362,"threads_started":1}
I20260812 00:27:44.519119 3650 heartbeater.cc:347] Connected to a master server at 127.29.190.190:33227
I20260812 00:27:44.519544 3650 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:44.520394 3650 heartbeater.cc:511] Master 127.29.190.190:33227 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
I20260812 00:27:44.522897 3376 ts_manager.cc:194] Registered new tserver with Master: 4cfe86585f9e4dbaa8cfdf29d7098ba2 (127.29.190.129:33801)
I20260812 00:27:44.524575 3376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:38213
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:27:44.554446 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33227
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:44.910158 3657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:44.910485 3657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:44.910593 3657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:44.918604 3657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:44.918749 3657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:44.918870 3657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:44.930073 3657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:44.931885 3657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:44.933409 3657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:44.948305 3668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:44.948338 3670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:44.948376 3672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:44.950627 3657 server_base.cc:1034] running on GCE node
I20260812 00:27:44.951388 3657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:44.952754 3657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:44.954152 3657 hybrid_clock.cc:648] HybridClock initialized: now 1786494464954076 us; error 60 us; skew 500 ppm
I20260812 00:27:44.954566 3657 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:44 dist-test-slave-c12x krb5kdc[3309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494464, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:44.961048 3657 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:27:44.962865 3657 webserver.cc:460] Webserver started at http://127.29.190.130:43811/ using document root <none> and password file <none>
I20260812 00:27:44.963691 3657 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:44.963807 3657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:44.964097 3657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:44.967147 3657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "ffdaca2714744d138c3a7929d4b8b695"
format_stamp: "Formatted at 2026-08-12 00:27:44 on dist-test-slave-c12x"
server_key: "fd1cce1a05a016f5f1590f0c43a2c92a"
server_key_iv: "e982793c16b70f7a03b3db6bc26565ff"
server_key_version: "encryptionkey@0"
I20260812 00:27:44.968025 3657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "ffdaca2714744d138c3a7929d4b8b695"
format_stamp: "Formatted at 2026-08-12 00:27:44 on dist-test-slave-c12x"
server_key: "fd1cce1a05a016f5f1590f0c43a2c92a"
server_key_iv: "e982793c16b70f7a03b3db6bc26565ff"
server_key_version: "encryptionkey@0"
I20260812 00:27:44.973780 3657 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 00:27:44.977661 3680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:44.979192 3657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:27:44.979375 3657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "ffdaca2714744d138c3a7929d4b8b695"
format_stamp: "Formatted at 2026-08-12 00:27:44 on dist-test-slave-c12x"
server_key: "fd1cce1a05a016f5f1590f0c43a2c92a"
server_key_iv: "e982793c16b70f7a03b3db6bc26565ff"
server_key_version: "encryptionkey@0"
I20260812 00:27:44.979689 3657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:45.019668 3657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:45.024415 3657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:45.024731 3657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:45.025759 3657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:45.027175 3657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:45.027256 3657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:45.027424 3657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:45.027530 3657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 00:27:45.063769 3657 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:45169
I20260812 00:27:45.063881 3850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:45169 every 8 connection(s)
I20260812 00:27:45.065160 3657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:45.070647 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 3657
I20260812 00:27:45.070854 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:45.071412 30458 external_mini_cluster.cc:1428] Setting key d736e4302f8a3cdfdb7325266988e300
Aug 12 00:27:45 dist-test-slave-c12x krb5kdc[3309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494464, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:45.087668 3854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:45.068078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:46359 (local address 127.29.190.190:33227)
0812 00:27:45.068551 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:45.068558 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:45.069566 (+ 1008us) server_negotiation.cc:407] Connection header received
0812 00:27:45.072125 (+ 2559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:45.072131 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:45.072228 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:45.072405 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:45.074109 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.074839 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.076481 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.076911 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.077073 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:45.080612 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:45.080617 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:45.080621 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:45.080654 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:45.083522 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.084395 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.084403 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.084406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.084721 (+ 315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.085313 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.085319 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.085322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.085755 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:45.086131 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:45.086985 (+ 854us) server_negotiation.cc:299] Negotiation successful
0812 00:27:45.087240 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":213,"threads_started":1}
I20260812 00:27:45.088709 3855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:45.068624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:33227 (local address 127.29.190.130:46359)
0812 00:27:45.069379 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:45.069418 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:45.071768 (+ 2350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:45.072676 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:45.072684 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:45.073322 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:45.073932 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:45.073949 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.074998 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.075006 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:45.076322 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:45.076335 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.077183 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.077192 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:45.077421 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:45.078141 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:45.078163 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:45.080366 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:45.083663 (+ 3297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:45.083673 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:45.083690 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:45.084258 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:45.084884 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:45.084890 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:45.084894 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:45.085156 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:45.086100 (+ 944us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:45.086109 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:45.086549 (+ 440us) client_negotiation.cc:769] Sending connection context
0812 00:27:45.086855 (+ 306us) client_negotiation.cc:240] Negotiation successful
0812 00:27:45.087466 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":301,"threads_started":1}
I20260812 00:27:45.090342 3851 heartbeater.cc:347] Connected to a master server at 127.29.190.190:33227
I20260812 00:27:45.090700 3851 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:45.091557 3851 heartbeater.cc:511] Master 127.29.190.190:33227 requested a full tablet report, sending...
I20260812 00:27:45.093325 3376 ts_manager.cc:194] Registered new tserver with Master: ffdaca2714744d138c3a7929d4b8b695 (127.29.190.130:45169)
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
I20260812 00:27:45.094440 3376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:46359
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:27:45.127307 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33227
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:45.492484 3860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:45.492759 3860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:45.492856 3860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:45.500150 3860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:45.500304 3860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:45.500449 3860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:45.510361 3860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:45.511832 3860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:45.513183 3860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:45.527200 3871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:45.527148 3869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:45.527590 3868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:45.528102 3860 server_base.cc:1034] running on GCE node
I20260812 00:27:45.528169 3650 heartbeater.cc:503] Master 127.29.190.190:33227 was elected leader, sending a full tablet report...
I20260812 00:27:45.528875 3860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:45.530004 3860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:45.531240 3860 hybrid_clock.cc:648] HybridClock initialized: now 1786494465531183 us; error 47 us; skew 500 ppm
I20260812 00:27:45.531646 3860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:45 dist-test-slave-c12x krb5kdc[3309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494465, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:45.535143 3860 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:27:45.536859 3860 webserver.cc:460] Webserver started at http://127.29.190.131:41577/ using document root <none> and password file <none>
I20260812 00:27:45.537573 3860 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:45.537678 3860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:45.537959 3860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:45.541229 3860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "7441469317c545af87cfb771f94c410b"
format_stamp: "Formatted at 2026-08-12 00:27:45 on dist-test-slave-c12x"
server_key: "0a6b9ce0574a50bd1ce7a588e7e680ca"
server_key_iv: "d22b0d5c59beb9cd2ad9d29fb42b5d93"
server_key_version: "encryptionkey@0"
I20260812 00:27:45.542105 3860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "7441469317c545af87cfb771f94c410b"
format_stamp: "Formatted at 2026-08-12 00:27:45 on dist-test-slave-c12x"
server_key: "0a6b9ce0574a50bd1ce7a588e7e680ca"
server_key_iv: "d22b0d5c59beb9cd2ad9d29fb42b5d93"
server_key_version: "encryptionkey@0"
I20260812 00:27:45.547861 3860 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 00:27:45.551764 3881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:45.553344 3860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:27:45.553555 3860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "7441469317c545af87cfb771f94c410b"
format_stamp: "Formatted at 2026-08-12 00:27:45 on dist-test-slave-c12x"
server_key: "0a6b9ce0574a50bd1ce7a588e7e680ca"
server_key_iv: "d22b0d5c59beb9cd2ad9d29fb42b5d93"
server_key_version: "encryptionkey@0"
I20260812 00:27:45.553764 3860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:45.577291 3860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:45.582079 3860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:45.582393 3860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:45.583559 3860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:45.585091 3860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:45.585173 3860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:45.585345 3860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:45.585407 3860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:45.630119 3860 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:38005
I20260812 00:27:45.630237 4044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:38005 every 8 connection(s)
I20260812 00:27:45.631680 3860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:45.633241 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 3860
I20260812 00:27:45.633461 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:45.633900 30458 external_mini_cluster.cc:1428] Setting key 2041b6ca7d607a9736cd8fa2cdccaae0
Aug 12 00:27:45 dist-test-slave-c12x krb5kdc[3309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494465, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:45.657028 4053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:45.635805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:41587 (local address 127.29.190.190:33227)
0812 00:27:45.639884 (+ 4079us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:45.639889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:45.639906 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:27:45.639956 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:45.639960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:45.640043 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:45.640139 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:45.641948 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.642810 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.644810 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.645311 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.645441 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:45.649830 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:45.649836 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:45.649840 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:45.649883 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:45.653154 (+ 3271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.654076 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.654082 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.654086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.654242 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.654763 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.654771 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.654775 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.655177 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:45.655368 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:45.656304 (+ 936us) server_negotiation.cc:299] Negotiation successful
0812 00:27:45.656579 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3965,"thread_start_us":3822,"threads_started":1}
I20260812 00:27:45.658273 4051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:45.635603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:33227 (local address 127.29.190.131:41587)
0812 00:27:45.636915 (+ 1312us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:45.636981 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:45.639097 (+ 2116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:45.640450 (+ 1353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:45.640459 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:45.641091 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:45.641734 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:45.641755 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.643015 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.643019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:45.644610 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:45.644627 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.645568 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.645574 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:45.645821 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:45.646673 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:45.646701 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:45.649538 (+ 2837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:45.653338 (+ 3800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:45.653350 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:45.653373 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:45.653913 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:45.654372 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:45.654378 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:45.654382 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:45.654620 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:45.655325 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:45.655335 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:45.655855 (+ 520us) client_negotiation.cc:769] Sending connection context
0812 00:27:45.656191 (+ 336us) client_negotiation.cc:240] Negotiation successful
0812 00:27:45.656830 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":965,"thread_start_us":688,"threads_started":1}
I20260812 00:27:45.660075 4045 heartbeater.cc:347] Connected to a master server at 127.29.190.190:33227
I20260812 00:27:45.660450 4045 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:45.661382 4045 heartbeater.cc:511] Master 127.29.190.190:33227 requested a full tablet report, sending...
I20260812 00:27:45.663388 3374 ts_manager.cc:194] Registered new tserver with Master: 7441469317c545af87cfb771f94c410b (127.29.190.131:38005)
I20260812 00:27:45.664757 3374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:41587
I20260812 00:27:45.664827 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:27:45 dist-test-slave-c12x krb5kdc[3309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:27:45 dist-test-slave-c12x krb5kdc[3309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:45.728017 4059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:45.709354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47944 (local address 127.29.190.129:33801)
0812 00:27:45.710291 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:45.710298 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:45.710326 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:27:45.710593 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:45.710602 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:45.710826 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:45.710976 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:45.712883 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.714035 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.715404 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.716139 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.716251 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:45.721325 (+ 5074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:45.721343 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:45.721359 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:45.721413 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:45.724939 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.725753 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.725763 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.725766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.725945 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.726344 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.726348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.726350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.726779 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:45.727041 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:45.727328 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 00:27:45.727689 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":766,"thread_start_us":617,"threads_started":1}
Aug 12 00:27:45 dist-test-slave-c12x krb5kdc[3309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:45.750360 4053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:45.733779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45046 (local address 127.29.190.190:33227)
0812 00:27:45.734028 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:45.734035 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:45.734278 (+ 243us) server_negotiation.cc:407] Connection header received
0812 00:27:45.734524 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:45.734530 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:45.734620 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:45.734741 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:45.736329 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.737221 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.738776 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.739238 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.739401 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:45.744330 (+ 4929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:45.744336 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:45.744340 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:45.744385 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:45.747305 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.748223 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.748228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.748231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.748398 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.748892 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.748897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.748900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.749317 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:45.749535 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:45.749893 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 00:27:45.750097 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
W20260812 00:27:45.751046 3374 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45046
I20260812 00:27:45.752163 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 3468
I20260812 00:27:45.766983 4059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:45.753148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47946 (local address 127.29.190.129:33801)
0812 00:27:45.753323 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:45.753327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:45.753675 (+ 348us) server_negotiation.cc:407] Connection header received
0812 00:27:45.753818 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:45.753822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:45.753917 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:45.754006 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:45.755378 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.756229 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.757776 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.758295 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.758427 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:45.761400 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:45.761406 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:45.761410 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:45.761457 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:45.764380 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.765089 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.765093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.765096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.765228 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.765620 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.765624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.765627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.765940 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:45.766153 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:45.766521 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 00:27:45.766719 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:27:45.767800 3644 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:45.854996 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 3468
I20260812 00:27:45.881327 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 3657
Aug 12 00:27:45 dist-test-slave-c12x krb5kdc[3309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:27:45.898501 4065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:45.882427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47434 (local address 127.29.190.130:45169)
0812 00:27:45.882948 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:45.882955 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:45.882982 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:27:45.883064 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:45.883071 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:45.883293 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:45.883482 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:45.884802 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.885874 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.887199 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:45.888092 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:45.888216 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:45.892484 (+ 4268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:45.892498 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:45.892516 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:45.892570 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:45.895674 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.896433 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.896440 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.896442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.896571 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:45.897025 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:45.897028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:45.897030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:45.897386 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:45.897617 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:45.897957 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 00:27:45.898184 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":255,"threads_started":1}
I20260812 00:27:45.899940 3845 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:45.986994 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 3657
I20260812 00:27:46.012835 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 3860
Aug 12 00:27:46 dist-test-slave-c12x krb5kdc[3309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:27:46.030372 4067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:46.013957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50664 (local address 127.29.190.131:38005)
0812 00:27:46.014600 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:46.014607 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:46.014637 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:27:46.014701 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:46.014707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:46.014922 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:46.015115 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:46.016528 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:46.017595 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:46.018955 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:46.019750 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:46.019902 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:46.024353 (+ 4451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:46.024366 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:46.024382 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:46.024426 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:46.027279 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:46.028085 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:46.028093 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:46.028095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:46.028238 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:46.028651 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:46.028655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:46.028657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:46.029029 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:46.029384 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:46.029726 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 00:27:46.030013 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":317,"threads_started":1}
I20260812 00:27:46.031898 4036 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:46.116425 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 3860
I20260812 00:27:46.142128 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 3327
I20260812 00:27:46.143560 3425 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:46.248781 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 3327
2026-08-12T00:27:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4469 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:46 dist-test-slave-c12x krb5kdc[4076](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:46 dist-test-slave-c12x krb5kdc[4076](info): set up 2 sockets
Aug 12 00:27:46 dist-test-slave-c12x krb5kdc[4076](info): commencing operation
krb5kdc: starting...
W20260812 00:27:47.647874 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.346s user 0.002s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:27:47 dist-test-slave-c12x krb5kdc[4076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:27:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:27:47.891156 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36857
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:36857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:48.245074 4099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:48.245378 4099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:48.245539 4099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:48.253053 4099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:48.253163 4099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:48.253209 4099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:48.253320 4099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:48.253387 4099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:48.263684 4099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:36857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:48.265220 4099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:48.266562 4099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:48.279265 4114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:48.279371 4108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:48.279305 4109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:48.280395 4099 server_base.cc:1034] running on GCE node
I20260812 00:27:48.281173 4099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:48.282642 4099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:48.283854 4099 hybrid_clock.cc:648] HybridClock initialized: now 1786494468283815 us; error 32 us; skew 500 ppm
I20260812 00:27:48.284243 4099 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:48 dist-test-slave-c12x krb5kdc[4076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494468, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:48.287583 4099 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:27:48.288846 4099 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:48.288990 4099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:48.289369 4099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:48.292694 4099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "4097a408cf1b4e1abb81d743423fe060"
format_stamp: "Formatted at 2026-08-12 00:27:48 on dist-test-slave-c12x"
server_key: "ce63d7d1bdcbf099965450af0a247c80"
server_key_iv: "b46a767bc4aade29cefe4e7f4906561b"
server_key_version: "encryptionkey@0"
I20260812 00:27:48.293543 4099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "4097a408cf1b4e1abb81d743423fe060"
format_stamp: "Formatted at 2026-08-12 00:27:48 on dist-test-slave-c12x"
server_key: "ce63d7d1bdcbf099965450af0a247c80"
server_key_iv: "b46a767bc4aade29cefe4e7f4906561b"
server_key_version: "encryptionkey@0"
I20260812 00:27:48.298866 4099 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 00:27:48.302577 4125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:48.304054 4099 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:27:48.304224 4099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "4097a408cf1b4e1abb81d743423fe060"
format_stamp: "Formatted at 2026-08-12 00:27:48 on dist-test-slave-c12x"
server_key: "ce63d7d1bdcbf099965450af0a247c80"
server_key_iv: "b46a767bc4aade29cefe4e7f4906561b"
server_key_version: "encryptionkey@0"
I20260812 00:27:48.304464 4099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:48.323668 4099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:48.328614 4099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:48.329041 4099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:48.349674 4099 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:36857
I20260812 00:27:48.349689 4196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:36857 every 8 connection(s)
I20260812 00:27:48.350708 4099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:48.354689 4197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:48.355576 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 4099
I20260812 00:27:48.355824 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:48.356479 30458 external_mini_cluster.cc:1428] Setting key e449fdfb97e1dab3bc7e7a85200e56aa
I20260812 00:27:48.368968 4197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060: Bootstrap starting.
Aug 12 00:27:48 dist-test-slave-c12x krb5kdc[4076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:48.373325 4197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:48.374665 4197 log.cc:824] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:48.378590 4197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060: No bootstrap required, opened a new log
I20260812 00:27:48.381604 4203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:48.358835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41640 (local address 127.29.190.190:36857)
0812 00:27:48.359702 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:48.359715 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:48.359761 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:27:48.361473 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:48.361499 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:48.361936 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:48.362390 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:48.364128 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:48.365707 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:48.367058 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:48.367888 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:48.368108 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:48.373041 (+ 4933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:48.373051 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:48.373068 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:48.373117 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:48.376913 (+ 3796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:48.377931 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:48.377937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:48.377944 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:48.378118 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:48.378599 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:48.378602 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:48.378604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:48.379209 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:48.379531 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:48.380055 (+ 524us) server_negotiation.cc:299] Negotiation successful
0812 00:27:48.380453 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":622,"thread_start_us":485,"threads_started":1}
I20260812 00:27:48.388537 4197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4097a408cf1b4e1abb81d743423fe060" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36857 } }
I20260812 00:27:48.388985 4197 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:48.389139 4197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4097a408cf1b4e1abb81d743423fe060, State: Initialized, Role: FOLLOWER
I20260812 00:27:48.389851 4197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4097a408cf1b4e1abb81d743423fe060" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36857 } }
I20260812 00:27:48.390131 4197 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:48.390297 4197 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:48.390523 4197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:48.393332 4197 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4097a408cf1b4e1abb81d743423fe060" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36857 } }
I20260812 00:27:48.393857 4197 leader_election.cc:302] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4097a408cf1b4e1abb81d743423fe060; no voters:
I20260812 00:27:48.394481 4197 leader_election.cc:288] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:48.394652 4205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:48.395390 4205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [term 1 LEADER]: Becoming Leader. State: Replica: 4097a408cf1b4e1abb81d743423fe060, State: Running, Role: LEADER
I20260812 00:27:48.396014 4205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4097a408cf1b4e1abb81d743423fe060" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36857 } }
I20260812 00:27:48.396934 4197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:48.399272 4207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4097a408cf1b4e1abb81d743423fe060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4097a408cf1b4e1abb81d743423fe060" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36857 } } }
I20260812 00:27:48.399245 4208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4097a408cf1b4e1abb81d743423fe060. Latest consensus state: current_term: 1 leader_uuid: "4097a408cf1b4e1abb81d743423fe060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4097a408cf1b4e1abb81d743423fe060" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36857 } } }
I20260812 00:27:48.399971 4208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:48.399971 4207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:48.402133 4213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:48.409003 4213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:48.419003 4213 catalog_manager.cc:1347] Generated new cluster ID: 9be5e021f97f4bc9a14c915e790a9865
I20260812 00:27:48.419147 4213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:48.453694 4213 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:48.455114 4213 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:48.463708 4213 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060: Generated new TSK 0
I20260812 00:27:48.464807 4213 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:27:48.540548 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36857
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:48.899003 4238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:48.899340 4238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:48.899663 4238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:48.907631 4238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:48.907783 4238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:48.908016 4238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:48.919327 4238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:48.920871 4238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:48.922260 4238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:48.937203 4247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:48.937117 4252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:48.937147 4248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:48.937948 4238 server_base.cc:1034] running on GCE node
I20260812 00:27:48.938673 4238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:48.939810 4238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:48.941030 4238 hybrid_clock.cc:648] HybridClock initialized: now 1786494468940977 us; error 41 us; skew 500 ppm
I20260812 00:27:48.941387 4238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:48 dist-test-slave-c12x krb5kdc[4076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494468, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:48.945200 4238 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:27:48.946887 4238 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:48.947068 4238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:48.947549 4238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:48.951098 4238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "493e39c34dd14de29b834b32dc78571d"
format_stamp: "Formatted at 2026-08-12 00:27:48 on dist-test-slave-c12x"
server_key: "b56ca10acfad3d2a1b81842d5d34991b"
server_key_iv: "35f30aa2a6775fa5f662ff6ebce619d1"
server_key_version: "encryptionkey@0"
I20260812 00:27:48.952147 4238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "493e39c34dd14de29b834b32dc78571d"
format_stamp: "Formatted at 2026-08-12 00:27:48 on dist-test-slave-c12x"
server_key: "b56ca10acfad3d2a1b81842d5d34991b"
server_key_iv: "35f30aa2a6775fa5f662ff6ebce619d1"
server_key_version: "encryptionkey@0"
I20260812 00:27:48.958166 4238 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:27:48.962396 4260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:48.964110 4238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:27:48.964301 4238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "493e39c34dd14de29b834b32dc78571d"
format_stamp: "Formatted at 2026-08-12 00:27:48 on dist-test-slave-c12x"
server_key: "b56ca10acfad3d2a1b81842d5d34991b"
server_key_iv: "35f30aa2a6775fa5f662ff6ebce619d1"
server_key_version: "encryptionkey@0"
I20260812 00:27:48.964566 4238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:48.977010 4238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:48.981042 4238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:48.981331 4238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:48.982343 4238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:48.983839 4238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:48.983965 4238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:48.984107 4238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:48.984202 4238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:49.019384 4238 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:36125
I20260812 00:27:49.019506 4427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:36125 every 8 connection(s)
I20260812 00:27:49.020355 4238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:49.026728 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 4238
I20260812 00:27:49.026980 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:49.027696 30458 external_mini_cluster.cc:1428] Setting key 9f468b20e587170031abae07771eb331
Aug 12 00:27:49 dist-test-slave-c12x krb5kdc[4076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494468, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:49.043300 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:49.022947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:48141 (local address 127.29.190.190:36857)
0812 00:27:49.023513 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:49.023518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:49.024461 (+ 943us) server_negotiation.cc:407] Connection header received
0812 00:27:49.026404 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:49.026410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:49.026527 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:49.026657 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:49.028469 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:49.029289 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:49.030927 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:49.031340 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:49.031501 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:49.035705 (+ 4204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:49.035711 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:49.035715 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:49.035756 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:49.038935 (+ 3179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:49.040246 (+ 1311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:49.040251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:49.040253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:49.040405 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:49.041001 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:49.041005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:49.041007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:49.041327 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:49.041454 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:49.042738 (+ 1284us) server_negotiation.cc:299] Negotiation successful
0812 00:27:49.042991 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":280,"threads_started":1}
I20260812 00:27:49.045125 4432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:49.023341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36857 (local address 127.29.190.129:48141)
0812 00:27:49.024179 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:49.024220 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:49.026091 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:49.026947 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:49.026957 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:49.027634 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:49.028277 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:49.028296 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:49.029485 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:49.029489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:49.030761 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:49.030775 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:49.031623 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:49.031631 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:49.031872 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:49.032703 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:49.032734 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:49.035354 (+ 2620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:49.039163 (+ 3809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:49.039179 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:49.039206 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:49.040052 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:49.040540 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:49.040549 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:49.040556 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:49.040851 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:49.041480 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:49.041492 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:49.042086 (+ 594us) client_negotiation.cc:769] Sending connection context
0812 00:27:49.042550 (+ 464us) client_negotiation.cc:240] Negotiation successful
0812 00:27:49.043273 (+ 723us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":336,"threads_started":1}
I20260812 00:27:49.047277 4428 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36857
I20260812 00:27:49.047712 4428 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:49.048528 4428 heartbeater.cc:511] Master 127.29.190.190:36857 requested a full tablet report, sending...
I20260812 00:27:49.050860 4147 ts_manager.cc:194] Registered new tserver with Master: 493e39c34dd14de29b834b32dc78571d (127.29.190.129:36125)
I20260812 00:27:49.052498 4147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:48141
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:27:49.087764 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36857
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:49.448587 4438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:49.448894 4438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:49.448997 4438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:49.456444 4438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:49.456578 4438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:49.456703 4438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:49.467084 4438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:49.468549 4438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:49.469934 4438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:49.483219 4445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:49.483253 4446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:49.483327 4451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:49.484807 4438 server_base.cc:1034] running on GCE node
I20260812 00:27:49.485602 4438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:49.486748 4438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:49.487996 4438 hybrid_clock.cc:648] HybridClock initialized: now 1786494469487948 us; error 69 us; skew 500 ppm
I20260812 00:27:49.488363 4438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:49 dist-test-slave-c12x krb5kdc[4076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494469, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:49.491927 4438 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:27:49.493299 4438 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:49.493450 4438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:49.493806 4438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:49.497251 4438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "82efa515a6c34dde92a8380ef0d96872"
format_stamp: "Formatted at 2026-08-12 00:27:49 on dist-test-slave-c12x"
server_key: "4b5e01a8249433261301a007a9863493"
server_key_iv: "69bfa58d0b51cc82618258eea4766e8c"
server_key_version: "encryptionkey@0"
I20260812 00:27:49.498219 4438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "82efa515a6c34dde92a8380ef0d96872"
format_stamp: "Formatted at 2026-08-12 00:27:49 on dist-test-slave-c12x"
server_key: "4b5e01a8249433261301a007a9863493"
server_key_iv: "69bfa58d0b51cc82618258eea4766e8c"
server_key_version: "encryptionkey@0"
I20260812 00:27:49.504215 4438 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:27:49.508285 4461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:49.509831 4438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260812 00:27:49.510046 4438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "82efa515a6c34dde92a8380ef0d96872"
format_stamp: "Formatted at 2026-08-12 00:27:49 on dist-test-slave-c12x"
server_key: "4b5e01a8249433261301a007a9863493"
server_key_iv: "69bfa58d0b51cc82618258eea4766e8c"
server_key_version: "encryptionkey@0"
I20260812 00:27:49.510288 4438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:49.523955 4438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:49.528614 4438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:49.528939 4438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:49.530313 4438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:49.532073 4438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:49.532204 4438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:49.532341 4438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:49.532433 4438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:49.569940 4438 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:46507
I20260812 00:27:49.570050 4618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:46507 every 8 connection(s)
I20260812 00:27:49.570875 4438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:49.572772 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 4438
I20260812 00:27:49.573061 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:49.573714 30458 external_mini_cluster.cc:1428] Setting key 61742b820ebe190c392b8a2d83ac1eb9
Aug 12 00:27:49 dist-test-slave-c12x krb5kdc[4076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494469, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:49.594987 4621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:49.574186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:38053 (local address 127.29.190.190:36857)
0812 00:27:49.574760 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:49.574766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:49.577738 (+ 2972us) server_negotiation.cc:407] Connection header received
0812 00:27:49.577799 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:49.577802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:49.577872 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:49.578005 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:49.579675 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:49.580438 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:49.582064 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:49.582506 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:49.582658 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:49.587971 (+ 5313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:49.587981 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:49.587984 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:49.588024 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:49.590894 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:49.592118 (+ 1224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:49.592123 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:49.592125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:49.592286 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:49.592907 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:49.592928 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:49.592930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:49.593260 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:49.593411 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:49.594481 (+ 1070us) server_negotiation.cc:299] Negotiation successful
0812 00:27:49.594701 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":296,"threads_started":1}
I20260812 00:27:49.596758 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:49.574723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36857 (local address 127.29.190.130:38053)
0812 00:27:49.575630 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:49.575679 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:49.577427 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:49.578273 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:49.578283 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:49.578834 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:49.579420 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:49.579507 (+ 87us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:49.580617 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:49.580630 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:49.581893 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:49.581906 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:49.582764 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:49.582772 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:49.583014 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:49.583974 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:49.584013 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:49.587642 (+ 3629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:49.591084 (+ 3442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:49.591098 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:49.591122 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:49.591941 (+ 819us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:49.592427 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:49.592443 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:49.592450 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:49.592740 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:49.593424 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:49.593443 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:49.593992 (+ 549us) client_negotiation.cc:769] Sending connection context
0812 00:27:49.594356 (+ 364us) client_negotiation.cc:240] Negotiation successful
0812 00:27:49.595026 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":387,"threads_started":1}
I20260812 00:27:49.598613 4619 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36857
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
I20260812 00:27:49.599001 4619 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:49.599850 4619 heartbeater.cc:511] Master 127.29.190.190:36857 requested a full tablet report, sending...
I20260812 00:27:49.601704 4147 ts_manager.cc:194] Registered new tserver with Master: 82efa515a6c34dde92a8380ef0d96872 (127.29.190.130:46507)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
I20260812 00:27:49.602933 4147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:38053
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:27:49.637334 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36857
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:27:50.009290 4627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:50.009625 4627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:50.009730 4627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:50.017663 4627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:50.017884 4627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:50.018119 4627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:50.034206 4627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:50.036001 4627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:50.037484 4627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:50.052722 4635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:50.052704 4633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:50.053428 4637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:50.053886 4627 server_base.cc:1034] running on GCE node
I20260812 00:27:50.054610 4627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:50.055812 4627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:50.055990 4428 heartbeater.cc:503] Master 127.29.190.190:36857 was elected leader, sending a full tablet report...
I20260812 00:27:50.057055 4627 hybrid_clock.cc:648] HybridClock initialized: now 1786494470057000 us; error 47 us; skew 500 ppm
I20260812 00:27:50.057437 4627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:27:50 dist-test-slave-c12x krb5kdc[4076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494470, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:27:50.066388 4627 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:27:50.067906 4627 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:50.068039 4627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:50.068460 4627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:50.071777 4627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "431ead8cfa644a93b22a8f4fdfecea2b"
format_stamp: "Formatted at 2026-08-12 00:27:50 on dist-test-slave-c12x"
server_key: "7bca3124cc912bc64ca4b54cbc2d96fa"
server_key_iv: "ee50d67eb0aa5bb09008a565066c803e"
server_key_version: "encryptionkey@0"
I20260812 00:27:50.072646 4627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "431ead8cfa644a93b22a8f4fdfecea2b"
format_stamp: "Formatted at 2026-08-12 00:27:50 on dist-test-slave-c12x"
server_key: "7bca3124cc912bc64ca4b54cbc2d96fa"
server_key_iv: "ee50d67eb0aa5bb09008a565066c803e"
server_key_version: "encryptionkey@0"
I20260812 00:27:50.078393 4627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:27:50.082155 4646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:50.083767 4627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:27:50.083967 4627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "431ead8cfa644a93b22a8f4fdfecea2b"
format_stamp: "Formatted at 2026-08-12 00:27:50 on dist-test-slave-c12x"
server_key: "7bca3124cc912bc64ca4b54cbc2d96fa"
server_key_iv: "ee50d67eb0aa5bb09008a565066c803e"
server_key_version: "encryptionkey@0"
I20260812 00:27:50.084204 4627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:50.106796 4627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:50.111814 4627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:50.112113 4627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:50.113421 4627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:50.115099 4627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:50.115193 4627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:50.115341 4627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:50.115408 4627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:50.152563 4627 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:44561
I20260812 00:27:50.152659 4822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:44561 every 8 connection(s)
I20260812 00:27:50.153518 4627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:50.155807 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 4627
I20260812 00:27:50.156034 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:50.156628 30458 external_mini_cluster.cc:1428] Setting key 51e01b0ee6bb01ec668e9f669607bcd0
Aug 12 00:27:50 dist-test-slave-c12x krb5kdc[4076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494470, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:27:50.175833 4825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.156558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:53411 (local address 127.29.190.190:36857)
0812 00:27:50.157105 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.157110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.158229 (+ 1119us) server_negotiation.cc:407] Connection header received
0812 00:27:50.160232 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.160236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.160310 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.160410 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:50.161950 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.162817 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.164639 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.165112 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.165222 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.169109 (+ 3887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:50.169114 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:50.169118 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:50.169153 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:50.172577 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.173349 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.173355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.173359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.173499 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.173953 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.173958 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.173961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.174258 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:50.174423 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.175165 (+ 742us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.175406 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":277,"threads_started":1}
I20260812 00:27:50.176888 4826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.157217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36857 (local address 127.29.190.131:53411)
0812 00:27:50.158078 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:50.158127 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:50.159962 (+ 1835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:50.160620 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:50.160628 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:50.161195 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:50.161770 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.161788 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.163008 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.163012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.164479 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.164492 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.165335 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.165341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.165581 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.166269 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:27:50.166293 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:50.168873 (+ 2580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:50.172718 (+ 3845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:50.172729 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:50.172755 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:50.173211 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:50.173618 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:27:50.173624 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:27:50.173627 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:27:50.173824 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:27:50.174403 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:50.174410 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:50.174778 (+ 368us) client_negotiation.cc:769] Sending connection context
0812 00:27:50.175062 (+ 284us) client_negotiation.cc:240] Negotiation successful
0812 00:27:50.175674 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":378,"threads_started":1}
I20260812 00:27:50.178292 4823 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36857
I20260812 00:27:50.178622 4823 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:50.179289 4823 heartbeater.cc:511] Master 127.29.190.190:36857 requested a full tablet report, sending...
I20260812 00:27:50.180810 4147 ts_manager.cc:194] Registered new tserver with Master: 431ead8cfa644a93b22a8f4fdfecea2b (127.29.190.131:44561)
I20260812 00:27:50.181638 4147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:53411
I20260812 00:27:50.185444 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:27:50.204787 4825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.190730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41642 (local address 127.29.190.190:36857)
0812 00:27:50.190919 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.190924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.191553 (+ 629us) server_negotiation.cc:407] Connection header received
0812 00:27:50.191708 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.191712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.191782 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.191878 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:50.193529 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.194311 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.195712 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.196123 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.196220 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.198674 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:50.198679 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:50.198683 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:50.198718 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:50.201730 (+ 3012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.202543 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.202547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.202550 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.202684 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.203208 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.203212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.203214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.203740 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:50.203949 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.204317 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.204552 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:27:50.209453 4147 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:27:50.216933 4147 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:50.239910 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.230306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49550 (local address 127.29.190.131:44561)
0812 00:27:50.231030 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.231042 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.231225 (+ 183us) server_negotiation.cc:407] Connection header received
0812 00:27:50.231568 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.231581 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.231864 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.232065 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:50.233817 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.235142 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.237141 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.238549 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.238769 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.238989 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.239339 (+ 350us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.239550 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":755,"threads_started":1}
I20260812 00:27:50.239936 4841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.230085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:44561 (local address 127.0.0.1:49550)
0812 00:27:50.230980 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:50.231042 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:50.231244 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:50.232416 (+ 1172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:50.232427 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:50.232469 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:50.232929 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.232945 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.235310 (+ 2365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.235318 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.236864 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.236878 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.238831 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.238840 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.239092 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.239139 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:27:50.239290 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 00:27:50.239529 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":448,"threads_started":1}
I20260812 00:27:50.243083 4843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.231386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:36125 (local address 127.0.0.1:44460)
0812 00:27:50.231986 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:50.232012 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:50.232156 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:50.234210 (+ 2054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:50.234217 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:50.234249 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:50.234798 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.234819 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.237131 (+ 2312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.237137 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.239961 (+ 2824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.239975 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.242056 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.242062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.242333 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.242369 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:27:50.242457 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:27:50.242612 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":203,"thread_start_us":303,"threads_started":1}
I20260812 00:27:50.243667 4846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.232655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.29.190.130:46507)
0812 00:27:50.233837 (+ 1182us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.233845 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.233869 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:27:50.233955 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.233963 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.234192 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.235082 (+ 890us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:50.235303 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.236960 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.240170 (+ 3210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.241744 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.242407 (+ 663us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.242600 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.242859 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.243042 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1031,"thread_start_us":905,"threads_started":1}
I20260812 00:27:50.244029 4844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.231816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44460 (local address 127.29.190.129:36125)
0812 00:27:50.233592 (+ 1776us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.233603 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.233636 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:27:50.233741 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.233750 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.233988 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.235035 (+ 1047us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:50.235292 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.236956 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.240170 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.241744 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.243226 (+ 1482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.243458 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.243530 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.243666 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1552,"thread_start_us":1390,"threads_started":1}
I20260812 00:27:50.245105 4845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.232091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:46507 (local address 127.0.0.1:51630)
0812 00:27:50.232786 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:50.232807 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:50.232949 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:50.234406 (+ 1457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:50.234410 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:50.234433 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:50.234881 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.234894 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.237132 (+ 2238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.237137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.239958 (+ 2821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.239975 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.242054 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.242062 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.242642 (+ 580us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.242676 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:27:50.242782 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:27:50.242919 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":472,"thread_start_us":775,"threads_started":1}
I20260812 00:27:50.244577 4722 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5f596654f942158429e02f3daba052 (DEFAULT_TABLE table=test-table [id=05fea14a5ec04233b052511643853046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:50.246240 4722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5f596654f942158429e02f3daba052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:50.247905 4334 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5f596654f942158429e02f3daba052 (DEFAULT_TABLE table=test-table [id=05fea14a5ec04233b052511643853046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:50.248689 4524 tablet_service.cc:1467] Processing CreateTablet for tablet 3c5f596654f942158429e02f3daba052 (DEFAULT_TABLE table=test-table [id=05fea14a5ec04233b052511643853046]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:50.249461 4334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5f596654f942158429e02f3daba052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:50.249881 4524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c5f596654f942158429e02f3daba052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:50.262671 4849 tablet_bootstrap.cc:492] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Bootstrap starting.
I20260812 00:27:50.263622 4851 tablet_bootstrap.cc:492] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Bootstrap starting.
I20260812 00:27:50.265045 4853 tablet_bootstrap.cc:492] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: Bootstrap starting.
I20260812 00:27:50.267889 4853 tablet_bootstrap.cc:654] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:50.267935 4849 tablet_bootstrap.cc:654] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:50.268151 4851 tablet_bootstrap.cc:654] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:50.269352 4853 log.cc:824] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:50.269383 4851 log.cc:824] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:50.269407 4849 log.cc:824] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:50.274336 4851 tablet_bootstrap.cc:492] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: No bootstrap required, opened a new log
I20260812 00:27:50.274376 4853 tablet_bootstrap.cc:492] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: No bootstrap required, opened a new log
I20260812 00:27:50.274653 4851 ts_tablet_manager.cc:1397] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260812 00:27:50.274669 4853 ts_tablet_manager.cc:1397] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 00:27:50.275012 4849 tablet_bootstrap.cc:492] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: No bootstrap required, opened a new log
I20260812 00:27:50.275290 4849 ts_tablet_manager.cc:1397] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.007s
I20260812 00:27:50.282375 4851 raft_consensus.cc:348] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.282788 4851 raft_consensus.cc:374] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:50.282902 4851 raft_consensus.cc:729] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 431ead8cfa644a93b22a8f4fdfecea2b, State: Initialized, Role: FOLLOWER
I20260812 00:27:50.283654 4851 consensus_queue.cc:260] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.284826 4823 heartbeater.cc:503] Master 127.29.190.190:36857 was elected leader, sending a full tablet report...
I20260812 00:27:50.285600 4851 ts_tablet_manager.cc:1428] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260812 00:27:50.285490 4853 raft_consensus.cc:348] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.285931 4853 raft_consensus.cc:374] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:50.286048 4853 raft_consensus.cc:729] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 493e39c34dd14de29b834b32dc78571d, State: Initialized, Role: FOLLOWER
I20260812 00:27:50.286859 4853 consensus_queue.cc:260] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.287873 4849 raft_consensus.cc:348] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.288420 4849 raft_consensus.cc:374] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:50.288540 4849 raft_consensus.cc:729] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82efa515a6c34dde92a8380ef0d96872, State: Initialized, Role: FOLLOWER
I20260812 00:27:50.289394 4849 consensus_queue.cc:260] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.290385 4853 ts_tablet_manager.cc:1428] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: Time spent starting tablet: real 0.016s user 0.008s sys 0.007s
I20260812 00:27:50.290591 4619 heartbeater.cc:503] Master 127.29.190.190:36857 was elected leader, sending a full tablet report...
I20260812 00:27:50.291285 4849 ts_tablet_manager.cc:1428] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Time spent starting tablet: real 0.016s user 0.010s sys 0.005s
W20260812 00:27:50.323115 4620 tablet.cc:2369] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:27:50.405148 4824 tablet.cc:2369] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:50.417521 4859 raft_consensus.cc:482] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:50.417840 4859 raft_consensus.cc:504] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.419651 4859 leader_election.cc:288] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 493e39c34dd14de29b834b32dc78571d (127.29.190.129:36125), 82efa515a6c34dde92a8380ef0d96872 (127.29.190.130:46507)
I20260812 00:27:50.427659 4826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.420209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:36125 (local address 127.29.190.131:55851)
0812 00:27:50.420493 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:50.420515 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:50.420722 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:50.421217 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:50.421228 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:50.421260 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:50.421487 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.421501 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.422957 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.422962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.425110 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.425127 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.426801 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.426806 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.426978 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.427006 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:27:50.427098 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 00:27:50.427291 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260812 00:27:50.427652 4844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.420242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:55851 (local address 127.29.190.129:36125)
0812 00:27:50.420480 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.420487 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.420615 (+ 128us) server_negotiation.cc:407] Connection header received
0812 00:27:50.420929 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.420938 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.421050 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.421165 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:50.421694 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.422805 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.425328 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.426580 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.426787 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.426905 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.427174 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.427323 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:27:50.428285 4846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.421012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:37609 (local address 127.29.190.130:46507)
0812 00:27:50.421234 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.421241 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.421650 (+ 409us) server_negotiation.cc:407] Connection header received
0812 00:27:50.421736 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.421744 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.421828 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.421939 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:27:50.422447 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.423427 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.425748 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.427057 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.427262 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.427342 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.427805 (+ 463us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.427982 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 00:27:50.428318 4864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.420685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:46507 (local address 127.29.190.131:37609)
0812 00:27:50.421494 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:50.421513 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:50.421641 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:50.421963 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:50.421967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:50.421987 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:27:50.422250 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.422257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.423640 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.423648 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.425561 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:50.425572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.427330 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.427336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:50.427577 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.427612 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:27:50.427731 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:27:50.427889 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":553,"threads_started":1}
I20260812 00:27:50.429298 4363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5f596654f942158429e02f3daba052" candidate_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "493e39c34dd14de29b834b32dc78571d" is_pre_election: true
I20260812 00:27:50.429781 4551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5f596654f942158429e02f3daba052" candidate_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82efa515a6c34dde92a8380ef0d96872" is_pre_election: true
I20260812 00:27:50.429929 4363 raft_consensus.cc:2454] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 431ead8cfa644a93b22a8f4fdfecea2b in term 0.
I20260812 00:27:50.430351 4551 raft_consensus.cc:2454] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 431ead8cfa644a93b22a8f4fdfecea2b in term 0.
I20260812 00:27:50.430783 4648 leader_election.cc:302] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 431ead8cfa644a93b22a8f4fdfecea2b, 493e39c34dd14de29b834b32dc78571d; no voters:
I20260812 00:27:50.431237 4859 raft_consensus.cc:2781] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:50.431375 4859 raft_consensus.cc:482] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:50.431555 4859 raft_consensus.cc:3037] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:50.433868 4859 raft_consensus.cc:504] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.434464 4859 leader_election.cc:288] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [CANDIDATE]: Term 1 election: Requested vote from peers 493e39c34dd14de29b834b32dc78571d (127.29.190.129:36125), 82efa515a6c34dde92a8380ef0d96872 (127.29.190.130:46507)
I20260812 00:27:50.435197 4551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5f596654f942158429e02f3daba052" candidate_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82efa515a6c34dde92a8380ef0d96872"
I20260812 00:27:50.435220 4363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c5f596654f942158429e02f3daba052" candidate_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "493e39c34dd14de29b834b32dc78571d"
I20260812 00:27:50.435523 4363 raft_consensus.cc:3037] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:50.435523 4551 raft_consensus.cc:3037] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:50.439093 4551 raft_consensus.cc:2454] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 431ead8cfa644a93b22a8f4fdfecea2b in term 1.
I20260812 00:27:50.439093 4363 raft_consensus.cc:2454] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 431ead8cfa644a93b22a8f4fdfecea2b in term 1.
I20260812 00:27:50.439658 4648 leader_election.cc:302] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 431ead8cfa644a93b22a8f4fdfecea2b, 493e39c34dd14de29b834b32dc78571d; no voters:
I20260812 00:27:50.440013 4859 raft_consensus.cc:2781] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:50.440548 4859 raft_consensus.cc:686] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 1 LEADER]: Becoming Leader. State: Replica: 431ead8cfa644a93b22a8f4fdfecea2b, State: Running, Role: LEADER
I20260812 00:27:50.441133 4859 consensus_queue.cc:237] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } }
I20260812 00:27:50.446375 4147 catalog_manager.cc:5495] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 431ead8cfa644a93b22a8f4fdfecea2b (127.29.190.131). New cstate: current_term: 1 leader_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "431ead8cfa644a93b22a8f4fdfecea2b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 44561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 } health_report { overall_health: UNKNOWN } } }
I20260812 00:27:50.483367 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.477412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49564 (local address 127.29.190.131:44561)
0812 00:27:50.477888 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.477893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.477908 (+ 15us) server_negotiation.cc:407] Connection header received
0812 00:27:50.477997 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.478001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.478089 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.478210 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:27:50.478735 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.479809 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.481171 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.481596 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.481699 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.482248 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:27:50.482860 (+ 612us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:27:50.483002 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.483084 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.483158 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346}
I20260812 00:27:50.492362 4363 raft_consensus.cc:1261] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 1 FOLLOWER]: Refusing update from remote peer 431ead8cfa644a93b22a8f4fdfecea2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:50.492383 4551 raft_consensus.cc:1261] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 1 FOLLOWER]: Refusing update from remote peer 431ead8cfa644a93b22a8f4fdfecea2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:50.493403 4859 consensus_queue.cc:1035] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "493e39c34dd14de29b834b32dc78571d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:50.493757 4865 consensus_queue.cc:1035] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82efa515a6c34dde92a8380ef0d96872" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:50.503472 4868 mvcc.cc:205] Tried to move back new op lower bound from 7317481351125864448 to 7317481350931009536. Current Snapshot: MvccSnapshot[applied={T|T < 7317481351125864448}]
I20260812 00:27:50.519222 4146 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:50.519590 4146 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:50.524091 4146 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4097a408cf1b4e1abb81d743423fe060: Sending DeleteTablet for 3 replicas of tablet 3c5f596654f942158429e02f3daba052
I20260812 00:27:50.525363 4722 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c5f596654f942158429e02f3daba052 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:50 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:49550
I20260812 00:27:50.525535 4334 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c5f596654f942158429e02f3daba052 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:50 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:44460
I20260812 00:27:50.526225 4524 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c5f596654f942158429e02f3daba052 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:50 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:51630
I20260812 00:27:50.527371 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 4238
I20260812 00:27:50.529513 4883 tablet_replica.cc:330] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: stopping tablet replica
I20260812 00:27:50.530074 4883 raft_consensus.cc:2229] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:27:50.530900 4883 raft_consensus.cc:2258] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:50.531950 4884 tablet_replica.cc:330] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: stopping tablet replica
I20260812 00:27:50.532456 4884 raft_consensus.cc:2229] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:50.533080 4884 raft_consensus.cc:2258] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:50.533802 4883 ts_tablet_manager.cc:1905] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:50.534758 4886 tablet_replica.cc:330] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: stopping tablet replica
I20260812 00:27:50.535250 4886 raft_consensus.cc:2229] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:50.535898 4886 raft_consensus.cc:2258] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:50.538197 4886 ts_tablet_manager.cc:1905] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:50.538197 4884 ts_tablet_manager.cc:1905] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:50.542025 4883 ts_tablet_manager.cc:1918] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:27:50.542220 4883 log.cc:1196] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/3c5f596654f942158429e02f3daba052
I20260812 00:27:50.542845 4883 ts_tablet_manager.cc:1939] T 3c5f596654f942158429e02f3daba052 P 431ead8cfa644a93b22a8f4fdfecea2b: Deleting consensus metadata
Aug 12 00:27:50 dist-test-slave-c12x krb5kdc[4076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:27:50.545630 4886 ts_tablet_manager.cc:1918] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:27:50.545598 4126 catalog_manager.cc:4841] TS 431ead8cfa644a93b22a8f4fdfecea2b (127.29.190.131:44561): tablet 3c5f596654f942158429e02f3daba052 (table test-table [id=05fea14a5ec04233b052511643853046]) successfully deleted
I20260812 00:27:50.545811 4886 log.cc:1196] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/3c5f596654f942158429e02f3daba052
I20260812 00:27:50.546419 4886 ts_tablet_manager.cc:1939] T 3c5f596654f942158429e02f3daba052 P 82efa515a6c34dde92a8380ef0d96872: Deleting consensus metadata
I20260812 00:27:50.546667 4884 ts_tablet_manager.cc:1918] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:27:50.546905 4884 log.cc:1196] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/3c5f596654f942158429e02f3daba052
I20260812 00:27:50.547621 4884 ts_tablet_manager.cc:1939] T 3c5f596654f942158429e02f3daba052 P 493e39c34dd14de29b834b32dc78571d: Deleting consensus metadata
I20260812 00:27:50.548391 4126 catalog_manager.cc:4841] TS 82efa515a6c34dde92a8380ef0d96872 (127.29.190.130:46507): tablet 3c5f596654f942158429e02f3daba052 (table test-table [id=05fea14a5ec04233b052511643853046]) successfully deleted
I20260812 00:27:50.549643 4126 catalog_manager.cc:4841] TS 493e39c34dd14de29b834b32dc78571d (127.29.190.129:36125): tablet 3c5f596654f942158429e02f3daba052 (table test-table [id=05fea14a5ec04233b052511643853046]) successfully deleted
I20260812 00:27:50.554943 4844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.528898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44470 (local address 127.29.190.129:36125)
0812 00:27:50.529166 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.529177 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.534062 (+ 4885us) server_negotiation.cc:407] Connection header received
0812 00:27:50.534274 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.534280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.534368 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.534488 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:50.536594 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.537787 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.539768 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.540454 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.540568 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.547117 (+ 6549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:50.547137 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:50.547158 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:50.547211 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:50.551702 (+ 4491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.552594 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.552605 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.552609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.552798 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.553178 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.553184 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.553188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.553697 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:50.554029 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.554311 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.554547 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 00:27:50.555891 4419 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:50.664013 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 4238
I20260812 00:27:50.692265 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 4438
Aug 12 00:27:50 dist-test-slave-c12x krb5kdc[4076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:27:50.709626 4846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.693148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51636 (local address 127.29.190.130:46507)
0812 00:27:50.693368 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.693374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.693398 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:27:50.693493 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.693499 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.693586 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.693734 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:50.694956 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.696217 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.697606 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.698249 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.698416 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.703163 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:50.703178 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:50.703196 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:50.703237 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:50.706351 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.707335 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.707342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.707344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.707547 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.707988 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.707992 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.707994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.708482 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:50.708714 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.709122 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.709304 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:27:50.710331 4613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:50.803705 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 4438
I20260812 00:27:50.842446 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 4627
Aug 12 00:27:50 dist-test-slave-c12x krb5kdc[4076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:27:50.861155 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:50.843481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49578 (local address 127.29.190.131:44561)
0812 00:27:50.843693 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:50.843701 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:50.843823 (+ 122us) server_negotiation.cc:407] Connection header received
0812 00:27:50.844082 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:50.844087 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:50.844168 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:50.844292 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:50.845742 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.846640 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.848188 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:50.848709 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:50.848872 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:50.854264 (+ 5392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:50.854283 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:50.854301 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:27:50.854362 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:50.857734 (+ 3372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.858562 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.858570 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.858576 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.858767 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:27:50.859234 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:27:50.859239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:27:50.859241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:27:50.859753 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:50.860124 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:50.860459 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 00:27:50.860719 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 00:27:50.862313 4817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:50.989830 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 4627
I20260812 00:27:51.016616 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 4099
I20260812 00:27:51.017978 4188 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:51.133216 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 4099
2026-08-12T00:27:51Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4884 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T00:27:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:51Z Disabled control of system clock
I20260812 00:27:51.220784 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:32789
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:39619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:32789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:27:51.587689 4902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:51.588006 4902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:51.588107 4902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:51.596127 4902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:51.596266 4902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:51.596311 4902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:51.596382 4902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:51.596436 4902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:27:51.606614 4902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:32789
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:32789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:51.608170 4902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:51.610280 4902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:51.627347 4913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:51.627492 4907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:51.627683 4909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:51.628757 4902 server_base.cc:1034] running on GCE node
I20260812 00:27:51.629689 4902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:51.631349 4902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:51.632682 4902 hybrid_clock.cc:648] HybridClock initialized: now 1786494471632632 us; error 39 us; skew 500 ppm
I20260812 00:27:51.633179 4902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:51.636185 4902 webserver.cc:460] Webserver started at http://127.29.190.190:44815/ using document root <none> and password file <none>
I20260812 00:27:51.637055 4902 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:51.637219 4902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:51.637617 4902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:51.641149 4902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "64d1d4c899af4a279a32086a8e0c8fab"
format_stamp: "Formatted at 2026-08-12 00:27:51 on dist-test-slave-c12x"
server_key: "6d242325feb3a268eef44ddc90eaf509"
server_key_iv: "f1538aea35309bcf5ba8ca64c70e638a"
server_key_version: "encryptionkey@0"
I20260812 00:27:51.642122 4902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "64d1d4c899af4a279a32086a8e0c8fab"
format_stamp: "Formatted at 2026-08-12 00:27:51 on dist-test-slave-c12x"
server_key: "6d242325feb3a268eef44ddc90eaf509"
server_key_iv: "f1538aea35309bcf5ba8ca64c70e638a"
server_key_version: "encryptionkey@0"
I20260812 00:27:51.648368 4902 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:27:51.652699 4923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:51.654254 4902 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:27:51.654490 4902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "64d1d4c899af4a279a32086a8e0c8fab"
format_stamp: "Formatted at 2026-08-12 00:27:51 on dist-test-slave-c12x"
server_key: "6d242325feb3a268eef44ddc90eaf509"
server_key_iv: "f1538aea35309bcf5ba8ca64c70e638a"
server_key_version: "encryptionkey@0"
I20260812 00:27:51.654745 4902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:51.661336 4902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:51.662302 4902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:51.662665 4902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:51.685564 4902 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:32789
I20260812 00:27:51.685791 5007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:32789 every 8 connection(s)
I20260812 00:27:51.687279 4902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:51.691917 5008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:51.697311 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 4902
I20260812 00:27:51.697542 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:51.698256 30458 external_mini_cluster.cc:1428] Setting key 470e090fd4998842c4de67f6bac0df23
I20260812 00:27:51.706454 5008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab: Bootstrap starting.
I20260812 00:27:51.709836 5012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:51.700711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60390 (local address 127.29.190.190:32789)
0812 00:27:51.702022 (+ 1311us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:51.702058 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:51.702116 (+ 58us) server_negotiation.cc:407] Connection header received
0812 00:27:51.704936 (+ 2820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:51.704973 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:51.705632 (+ 659us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:51.706171 (+ 539us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:51.707427 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:51.707463 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:51.707483 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:51.707505 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:51.707592 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:51.707617 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:51.707858 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:51.708010 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:27:51.708321 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":692,"thread_start_us":418,"threads_started":1}
I20260812 00:27:51.711004 5008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:51.712301 5008 log.cc:824] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:51.715411 5008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab: No bootstrap required, opened a new log
I20260812 00:27:51.724267 5008 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1d4c899af4a279a32086a8e0c8fab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32789 } }
I20260812 00:27:51.724762 5008 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:51.724905 5008 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d1d4c899af4a279a32086a8e0c8fab, State: Initialized, Role: FOLLOWER
I20260812 00:27:51.725585 5008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1d4c899af4a279a32086a8e0c8fab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32789 } }
I20260812 00:27:51.725880 5008 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:51.726084 5008 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:51.726312 5008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:51.728901 5008 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1d4c899af4a279a32086a8e0c8fab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32789 } }
I20260812 00:27:51.729539 5008 leader_election.cc:302] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64d1d4c899af4a279a32086a8e0c8fab; no voters:
I20260812 00:27:51.730365 5008 leader_election.cc:288] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:51.730538 5015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:51.731482 5015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [term 1 LEADER]: Becoming Leader. State: Replica: 64d1d4c899af4a279a32086a8e0c8fab, State: Running, Role: LEADER
I20260812 00:27:51.732067 5015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1d4c899af4a279a32086a8e0c8fab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32789 } }
I20260812 00:27:51.732970 5008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:51.735404 5016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64d1d4c899af4a279a32086a8e0c8fab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1d4c899af4a279a32086a8e0c8fab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32789 } } }
I20260812 00:27:51.735366 5020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64d1d4c899af4a279a32086a8e0c8fab. Latest consensus state: current_term: 1 leader_uuid: "64d1d4c899af4a279a32086a8e0c8fab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d1d4c899af4a279a32086a8e0c8fab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 32789 } } }
I20260812 00:27:51.736002 5020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:51.735870 5016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:51.737596 5027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:51.743048 5027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:51.753754 5027 catalog_manager.cc:1347] Generated new cluster ID: 08cb073ad994443196daaf354a203589
I20260812 00:27:51.753948 5027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:51.776623 5027 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:51.777107 5027 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:51.784787 5027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab: Generated new TSK 0
I20260812 00:27:51.785653 5027 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:27:51.799875 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32789
--builtin_ntp_servers=127.29.190.148:39619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 00:27:52.188611 5045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:52.188930 5045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:52.189122 5045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:52.196611 5045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:52.196723 5045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:52.196903 5045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:27:52.206354 5045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:52.207950 5045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:52.209899 5045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:52.224040 5052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:52.224165 5062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:52.224242 5060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:52.225380 5045 server_base.cc:1034] running on GCE node
I20260812 00:27:52.226055 5045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:52.227064 5045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:52.228304 5045 hybrid_clock.cc:648] HybridClock initialized: now 1786494472228262 us; error 54 us; skew 500 ppm
I20260812 00:27:52.228655 5045 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:52.231053 5045 webserver.cc:460] Webserver started at http://127.29.190.129:37229/ using document root <none> and password file <none>
I20260812 00:27:52.231901 5045 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:52.232048 5045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:52.232396 5045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:52.235706 5045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "43500cf6503d4d5ea7b21df3a1b17a6e"
format_stamp: "Formatted at 2026-08-12 00:27:52 on dist-test-slave-c12x"
server_key: "f5284d3d039582e3677f47de814fb5d9"
server_key_iv: "7d4431824644375a52ab42cdb824b42d"
server_key_version: "encryptionkey@0"
I20260812 00:27:52.236639 5045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "43500cf6503d4d5ea7b21df3a1b17a6e"
format_stamp: "Formatted at 2026-08-12 00:27:52 on dist-test-slave-c12x"
server_key: "f5284d3d039582e3677f47de814fb5d9"
server_key_iv: "7d4431824644375a52ab42cdb824b42d"
server_key_version: "encryptionkey@0"
I20260812 00:27:52.242818 5045 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260812 00:27:52.247295 5072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:52.249185 5045 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:27:52.249408 5045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "43500cf6503d4d5ea7b21df3a1b17a6e"
format_stamp: "Formatted at 2026-08-12 00:27:52 on dist-test-slave-c12x"
server_key: "f5284d3d039582e3677f47de814fb5d9"
server_key_iv: "7d4431824644375a52ab42cdb824b42d"
server_key_version: "encryptionkey@0"
I20260812 00:27:52.249713 5045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:52.256207 5045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:52.257099 5045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:52.257397 5045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:52.258531 5045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:52.260197 5045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:52.260327 5045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:52.260475 5045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:52.260577 5045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:52.299242 5045 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:43723
I20260812 00:27:52.299312 5250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:43723 every 8 connection(s)
I20260812 00:27:52.301059 5045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:27:52.309927 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 5045
I20260812 00:27:52.310176 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:27:52.310536 5254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:52.304217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:54299 (local address 127.29.190.190:32789)
0812 00:27:52.304738 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:52.304743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:52.306095 (+ 1352us) server_negotiation.cc:407] Connection header received
0812 00:27:52.307992 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:52.307998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:52.308093 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:52.308224 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:52.309684 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:52.309689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:52.309692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:52.309710 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:52.309759 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:52.309770 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:52.309920 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:52.310120 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 00:27:52.310199 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":304,"threads_started":1}
I20260812 00:27:52.310953 30458 external_mini_cluster.cc:1428] Setting key df02671729bfa8c94d556df4ab659ff3
I20260812 00:27:52.311697 5257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:52.304942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32789 (local address 127.29.190.129:54299)
0812 00:27:52.305916 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:52.305961 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:52.307686 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:52.308486 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:52.308494 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:52.308601 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:52.309329 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:27:52.309332 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:52.309371 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:27:52.309464 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:52.309876 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:52.309889 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:52.309899 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:27:52.310215 (+ 316us) client_negotiation.cc:240] Negotiation successful
0812 00:27:52.310503 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":296,"threads_started":1}
I20260812 00:27:52.313880 5251 heartbeater.cc:347] Connected to a master server at 127.29.190.190:32789
I20260812 00:27:52.314251 5251 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:52.314414 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32789
--builtin_ntp_servers=127.29.190.148:39619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 00:27:52.315006 5251 heartbeater.cc:511] Master 127.29.190.190:32789 requested a full tablet report, sending...
I20260812 00:27:52.317728 4957 ts_manager.cc:194] Registered new tserver with Master: 43500cf6503d4d5ea7b21df3a1b17a6e (127.29.190.129:43723)
W20260812 00:27:52.679612 5258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:52.679991 5258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:52.680152 5258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:52.687986 5258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:52.688143 5258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:52.688334 5258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:27:52.698056 5258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:52.699551 5258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:52.701606 5258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:52.716117 5264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:52.716081 5265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:52.716032 5269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:52.716957 5258 server_base.cc:1034] running on GCE node
I20260812 00:27:52.717669 5258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:52.718724 5258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:52.719974 5258 hybrid_clock.cc:648] HybridClock initialized: now 1786494472719927 us; error 59 us; skew 500 ppm
I20260812 00:27:52.720396 5258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:52.722867 5258 webserver.cc:460] Webserver started at http://127.29.190.130:41067/ using document root <none> and password file <none>
I20260812 00:27:52.723747 5258 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:52.723894 5258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:52.724264 5258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:52.727329 5258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "169bd53867fb4cc588de51aa39601b49"
format_stamp: "Formatted at 2026-08-12 00:27:52 on dist-test-slave-c12x"
server_key: "71df29078ecbb7ebc86dedd1bf8dc2f3"
server_key_iv: "b60f664386cbad3aa515f162b5daebb0"
server_key_version: "encryptionkey@0"
I20260812 00:27:52.728294 5258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "169bd53867fb4cc588de51aa39601b49"
format_stamp: "Formatted at 2026-08-12 00:27:52 on dist-test-slave-c12x"
server_key: "71df29078ecbb7ebc86dedd1bf8dc2f3"
server_key_iv: "b60f664386cbad3aa515f162b5daebb0"
server_key_version: "encryptionkey@0"
I20260812 00:27:52.735177 5258 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 00:27:52.739668 5280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:52.741451 5258 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:27:52.741673 5258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "169bd53867fb4cc588de51aa39601b49"
format_stamp: "Formatted at 2026-08-12 00:27:52 on dist-test-slave-c12x"
server_key: "71df29078ecbb7ebc86dedd1bf8dc2f3"
server_key_iv: "b60f664386cbad3aa515f162b5daebb0"
server_key_version: "encryptionkey@0"
I20260812 00:27:52.741966 5258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:52.749087 5258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:52.749981 5258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:52.750280 5258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:52.751672 5258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:52.753244 5258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:52.753368 5258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:52.753521 5258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:52.753599 5258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:52.793991 5258 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:46365
I20260812 00:27:52.794050 5454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:46365 every 8 connection(s)
I20260812 00:27:52.795509 5258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:27:52.802318 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 5258
I20260812 00:27:52.802527 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:27:52.803023 30458 external_mini_cluster.cc:1428] Setting key 5bf5032da4e19dc1e247c7fb95a7e8d9
I20260812 00:27:52.805310 5254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:52.798536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:46015 (local address 127.29.190.190:32789)
0812 00:27:52.798775 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:52.798780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:52.800384 (+ 1604us) server_negotiation.cc:407] Connection header received
0812 00:27:52.802488 (+ 2104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:52.802497 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:52.802583 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:52.802734 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:52.804490 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:52.804495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:52.804498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:52.804515 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:52.804553 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:52.804565 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:52.804684 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:52.804970 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 00:27:52.805029 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 00:27:52.806377 5460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:52.799067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32789 (local address 127.29.190.130:46015)
0812 00:27:52.800203 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:52.800242 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:52.802057 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:52.803073 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:52.803086 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:52.803220 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:52.804066 (+ 846us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:27:52.804069 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:52.804148 (+ 79us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:27:52.804278 (+ 130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:52.804678 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:52.804689 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:52.804698 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:27:52.804989 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 00:27:52.805285 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":432,"threads_started":1}
I20260812 00:27:52.806703 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32789
--builtin_ntp_servers=127.29.190.148:39619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 00:27:52.808017 5458 heartbeater.cc:347] Connected to a master server at 127.29.190.190:32789
I20260812 00:27:52.808369 5458 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:52.809010 5458 heartbeater.cc:511] Master 127.29.190.190:32789 requested a full tablet report, sending...
I20260812 00:27:52.810501 4957 ts_manager.cc:194] Registered new tserver with Master: 169bd53867fb4cc588de51aa39601b49 (127.29.190.130:46365)
W20260812 00:27:53.169781 5461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:53.170096 5461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:53.170188 5461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:53.177910 5461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:53.178037 5461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:53.178153 5461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:27:53.188566 5461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:32789
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:53.189963 5461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:53.191931 5461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:53.207163 5471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:53.207091 5473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:53.207116 5476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:53.208784 5461 server_base.cc:1034] running on GCE node
I20260812 00:27:53.209736 5461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:53.210846 5461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:53.212119 5461 hybrid_clock.cc:648] HybridClock initialized: now 1786494473212065 us; error 49 us; skew 500 ppm
I20260812 00:27:53.212481 5461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:53.214944 5461 webserver.cc:460] Webserver started at http://127.29.190.131:38945/ using document root <none> and password file <none>
I20260812 00:27:53.215801 5461 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:53.215937 5461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:53.216302 5461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:53.219290 5461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "5ccf95ebd2ec48c1ba0b3f964434360a"
format_stamp: "Formatted at 2026-08-12 00:27:53 on dist-test-slave-c12x"
server_key: "47907558b7bc5d5b958d748bd065d877"
server_key_iv: "5aca545a1668db1a5f9075de59b2632b"
server_key_version: "encryptionkey@0"
I20260812 00:27:53.220234 5461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "5ccf95ebd2ec48c1ba0b3f964434360a"
format_stamp: "Formatted at 2026-08-12 00:27:53 on dist-test-slave-c12x"
server_key: "47907558b7bc5d5b958d748bd065d877"
server_key_iv: "5aca545a1668db1a5f9075de59b2632b"
server_key_version: "encryptionkey@0"
I20260812 00:27:53.226352 5461 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 00:27:53.230448 5484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:53.232034 5461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:27:53.232228 5461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "5ccf95ebd2ec48c1ba0b3f964434360a"
format_stamp: "Formatted at 2026-08-12 00:27:53 on dist-test-slave-c12x"
server_key: "47907558b7bc5d5b958d748bd065d877"
server_key_iv: "5aca545a1668db1a5f9075de59b2632b"
server_key_version: "encryptionkey@0"
I20260812 00:27:53.232471 5461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:53.238962 5461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:53.239957 5461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:53.240259 5461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:53.241300 5461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:27:53.243027 5461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:27:53.243151 5461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:53.243301 5461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:27:53.243391 5461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:53.280727 5461 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:45639
I20260812 00:27:53.280838 5643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:45639 every 8 connection(s)
I20260812 00:27:53.282163 5461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:27:53.283668 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 5461
I20260812 00:27:53.283862 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:27:53.284529 30458 external_mini_cluster.cc:1428] Setting key 6dba5f729d967771bfa75ea1fa4ff25d
I20260812 00:27:53.292985 5254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.285880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:33295 (local address 127.29.190.190:32789)
0812 00:27:53.286080 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.286085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.288482 (+ 2397us) server_negotiation.cc:407] Connection header received
0812 00:27:53.290439 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.290444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.290505 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.290614 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.292214 (+ 1600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.292218 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.292222 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.292250 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.292287 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.292299 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.292413 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.292670 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.292733 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:27:53.294025 5651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.286667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:32789 (local address 127.29.190.131:33295)
0812 00:27:53.288260 (+ 1593us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.288314 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:53.290133 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:53.290881 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:53.290890 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:53.291021 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:53.291873 (+ 852us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:27:53.291877 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:53.291922 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:27:53.292020 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:53.292417 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:53.292426 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:53.292433 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:27:53.292687 (+ 254us) client_negotiation.cc:240] Negotiation successful
0812 00:27:53.292915 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":433,"threads_started":1}
I20260812 00:27:53.295794 5646 heartbeater.cc:347] Connected to a master server at 127.29.190.190:32789
I20260812 00:27:53.296226 5646 heartbeater.cc:464] Registering TS with master...
I20260812 00:27:53.296936 5646 heartbeater.cc:511] Master 127.29.190.190:32789 requested a full tablet report, sending...
I20260812 00:27:53.298702 4957 ts_manager.cc:194] Registered new tserver with Master: 5ccf95ebd2ec48c1ba0b3f964434360a (127.29.190.131:45639)
I20260812 00:27:53.301805 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:27:53.310144 5254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.307080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60406 (local address 127.29.190.190:32789)
0812 00:27:53.307342 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.307351 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.307867 (+ 516us) server_negotiation.cc:407] Connection header received
0812 00:27:53.308127 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.308132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.308192 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.308308 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.309425 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.309431 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.309436 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.309457 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.309503 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.309516 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.309667 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.309769 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.309842 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 00:27:53.314901 4957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60406:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 00:27:53.321602 5251 heartbeater.cc:503] Master 127.29.190.190:32789 was elected leader, sending a full tablet report...
W20260812 00:27:53.322944 4957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:27:53.356849 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.337611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:46365 (local address 127.0.0.1:60432)
0812 00:27:53.349891 (+ 12280us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.349972 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:53.350201 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:53.352277 (+ 2076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:53.352289 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:53.352393 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:53.353508 (+ 1115us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:27:53.353515 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:53.353558 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:27:53.353686 (+ 128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:53.355707 (+ 2021us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:53.355726 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:53.355741 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 00:27:53.356050 (+ 309us) client_negotiation.cc:240] Negotiation successful
0812 00:27:53.356185 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11836,"thread_start_us":13681,"threads_started":1}
I20260812 00:27:53.357259 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.337857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60432 (local address 127.29.190.130:46365)
0812 00:27:53.351560 (+ 13703us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.351567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.351597 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:27:53.351664 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.351669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.351981 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.353072 (+ 1091us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.355326 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.355340 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.355363 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.355398 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.355496 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.355526 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.356481 (+ 955us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.356586 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.356728 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13508,"thread_start_us":13371,"threads_started":1}
I20260812 00:27:53.358388 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.338201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53334 (local address 127.29.190.129:43723)
0812 00:27:53.350792 (+ 12591us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.350808 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.351888 (+ 1080us) server_negotiation.cc:407] Connection header received
0812 00:27:53.351989 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.352001 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.352259 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.352437 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.355532 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.355546 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.355565 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.355591 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.355667 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.355694 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.355908 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.357773 (+ 1865us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.357896 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12299,"thread_start_us":12608,"threads_started":1}
I20260812 00:27:53.358831 5662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.337914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53334)
0812 00:27:53.351627 (+ 13713us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.351647 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:53.351752 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:53.354235 (+ 2483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:53.354244 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:53.354278 (+ 34us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:53.355166 (+ 888us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:27:53.355172 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:53.355195 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:27:53.355259 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:53.355996 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:53.356004 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:53.356013 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:27:53.356194 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 00:27:53.356270 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13579,"thread_start_us":12466,"threads_started":1}
I20260812 00:27:53.361848 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.351815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:45639 (local address 127.0.0.1:33794)
0812 00:27:53.357446 (+ 5631us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.357470 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:53.357572 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:53.360363 (+ 2791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:53.360367 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:53.360396 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:53.360995 (+ 599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:27:53.360997 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:53.361010 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:27:53.361045 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:53.361506 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:53.361510 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:53.361513 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 00:27:53.361588 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 00:27:53.361629 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5497,"thread_start_us":6443,"threads_started":1}
I20260812 00:27:53.362191 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.352205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33794 (local address 127.29.190.131:45639)
0812 00:27:53.358299 (+ 6094us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.358311 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.358353 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:27:53.358439 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.358451 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.358799 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.358999 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.361229 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.361244 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.361260 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.361283 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.361357 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.361381 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.361590 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.361663 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.361767 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5916,"thread_start_us":5709,"threads_started":1}
I20260812 00:27:53.363801 5142 tablet_service.cc:1467] Processing CreateTablet for tablet 0133342edbb94e06bfaeb1aa367ec80c (DEFAULT_TABLE table=test-table [id=b6b4acd2b5714c7ea3d04e06e19f1c0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:53.364411 5356 tablet_service.cc:1467] Processing CreateTablet for tablet 0133342edbb94e06bfaeb1aa367ec80c (DEFAULT_TABLE table=test-table [id=b6b4acd2b5714c7ea3d04e06e19f1c0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:53.365237 5142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0133342edbb94e06bfaeb1aa367ec80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:53.365804 5356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0133342edbb94e06bfaeb1aa367ec80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:53.366055 5549 tablet_service.cc:1467] Processing CreateTablet for tablet 0133342edbb94e06bfaeb1aa367ec80c (DEFAULT_TABLE table=test-table [id=b6b4acd2b5714c7ea3d04e06e19f1c0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:27:53.367491 5549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0133342edbb94e06bfaeb1aa367ec80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:53.379170 5669 tablet_bootstrap.cc:492] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: Bootstrap starting.
I20260812 00:27:53.381470 5670 tablet_bootstrap.cc:492] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Bootstrap starting.
I20260812 00:27:53.383531 5671 tablet_bootstrap.cc:492] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Bootstrap starting.
I20260812 00:27:53.385321 5669 tablet_bootstrap.cc:654] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:53.385911 5670 tablet_bootstrap.cc:654] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:53.386528 5671 tablet_bootstrap.cc:654] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:53.386885 5669 log.cc:824] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:53.387239 5670 log.cc:824] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:53.387656 5671 log.cc:824] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:53.391968 5670 tablet_bootstrap.cc:492] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: No bootstrap required, opened a new log
I20260812 00:27:53.392184 5671 tablet_bootstrap.cc:492] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: No bootstrap required, opened a new log
I20260812 00:27:53.392273 5670 ts_tablet_manager.cc:1397] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260812 00:27:53.392496 5671 ts_tablet_manager.cc:1397] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 00:27:53.393072 5669 tablet_bootstrap.cc:492] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: No bootstrap required, opened a new log
I20260812 00:27:53.393369 5669 ts_tablet_manager.cc:1397] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.003s
I20260812 00:27:53.400257 5670 raft_consensus.cc:348] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.400667 5670 raft_consensus.cc:374] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:53.400803 5670 raft_consensus.cc:729] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169bd53867fb4cc588de51aa39601b49, State: Initialized, Role: FOLLOWER
I20260812 00:27:53.401473 5670 consensus_queue.cc:260] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.402688 5458 heartbeater.cc:503] Master 127.29.190.190:32789 was elected leader, sending a full tablet report...
I20260812 00:27:53.403383 5670 ts_tablet_manager.cc:1428] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260812 00:27:53.404850 5671 raft_consensus.cc:348] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.405454 5671 raft_consensus.cc:374] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:53.405640 5671 raft_consensus.cc:729] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccf95ebd2ec48c1ba0b3f964434360a, State: Initialized, Role: FOLLOWER
I20260812 00:27:53.405820 5669 raft_consensus.cc:348] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.406313 5669 raft_consensus.cc:374] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:53.406445 5669 raft_consensus.cc:729] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43500cf6503d4d5ea7b21df3a1b17a6e, State: Initialized, Role: FOLLOWER
I20260812 00:27:53.406388 5671 consensus_queue.cc:260] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.407137 5669 consensus_queue.cc:260] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.409695 5669 ts_tablet_manager.cc:1428] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
I20260812 00:27:53.410946 5646 heartbeater.cc:503] Master 127.29.190.190:32789 was elected leader, sending a full tablet report...
I20260812 00:27:53.411629 5671 ts_tablet_manager.cc:1428] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Time spent starting tablet: real 0.019s user 0.012s sys 0.007s
I20260812 00:27:53.477186 5682 raft_consensus.cc:482] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:27:53.477533 5682 raft_consensus.cc:504] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.479414 5682 leader_election.cc:288] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169bd53867fb4cc588de51aa39601b49 (127.29.190.130:46365), 43500cf6503d4d5ea7b21df3a1b17a6e (127.29.190.129:43723)
I20260812 00:27:53.483027 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.479955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:44783 (local address 127.29.190.129:43723)
0812 00:27:53.480170 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.480177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.480601 (+ 424us) server_negotiation.cc:407] Connection header received
0812 00:27:53.480800 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.480808 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.480896 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.481025 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.482296 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.482315 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.482318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.482337 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.482372 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.482386 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.482600 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.482659 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.482726 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:27:53.483037 5651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.479930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.29.190.131:44783)
0812 00:27:53.480416 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.480446 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:53.480615 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:53.481080 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:53.481083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:53.481105 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:53.482017 (+ 912us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:27:53.482021 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:53.482038 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:27:53.482082 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:53.482546 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:53.482552 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:53.482557 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:27:53.482666 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 00:27:53.482725 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343}
I20260812 00:27:53.483363 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.480149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:44827 (local address 127.29.190.130:46365)
0812 00:27:53.480346 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.480351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.481259 (+ 908us) server_negotiation.cc:407] Connection header received
0812 00:27:53.481433 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.481437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.481493 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.481578 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.482670 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.482676 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.482681 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.482709 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.482741 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.482752 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.482881 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.482996 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.483064 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:27:53.483532 5684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.480219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:46365 (local address 127.29.190.131:44827)
0812 00:27:53.481141 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.481159 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:53.481301 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:53.481705 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:53.481712 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:53.481739 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:27:53.482446 (+ 707us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:27:53.482454 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:27:53.482468 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:27:53.482509 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:27:53.482866 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:27:53.482870 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:27:53.482875 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:27:53.483005 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 00:27:53.483064 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"thread_start_us":527,"threads_started":1}
I20260812 00:27:53.484587 5181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0133342edbb94e06bfaeb1aa367ec80c" candidate_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" is_pre_election: true
I20260812 00:27:53.484829 5389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0133342edbb94e06bfaeb1aa367ec80c" candidate_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169bd53867fb4cc588de51aa39601b49" is_pre_election: true
I20260812 00:27:53.485183 5181 raft_consensus.cc:2454] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccf95ebd2ec48c1ba0b3f964434360a in term 0.
I20260812 00:27:53.485811 5389 raft_consensus.cc:2454] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccf95ebd2ec48c1ba0b3f964434360a in term 0.
I20260812 00:27:53.486181 5486 leader_election.cc:302] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43500cf6503d4d5ea7b21df3a1b17a6e, 5ccf95ebd2ec48c1ba0b3f964434360a; no voters:
I20260812 00:27:53.486696 5682 raft_consensus.cc:2781] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:27:53.486850 5682 raft_consensus.cc:482] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:27:53.486979 5682 raft_consensus.cc:3037] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:53.489389 5682 raft_consensus.cc:504] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.490101 5682 leader_election.cc:288] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [CANDIDATE]: Term 1 election: Requested vote from peers 169bd53867fb4cc588de51aa39601b49 (127.29.190.130:46365), 43500cf6503d4d5ea7b21df3a1b17a6e (127.29.190.129:43723)
I20260812 00:27:53.490727 5389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0133342edbb94e06bfaeb1aa367ec80c" candidate_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169bd53867fb4cc588de51aa39601b49"
I20260812 00:27:53.490757 5181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0133342edbb94e06bfaeb1aa367ec80c" candidate_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e"
I20260812 00:27:53.490980 5389 raft_consensus.cc:3037] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:53.491024 5181 raft_consensus.cc:3037] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:53.493889 5389 raft_consensus.cc:2454] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccf95ebd2ec48c1ba0b3f964434360a in term 1.
I20260812 00:27:53.493896 5181 raft_consensus.cc:2454] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccf95ebd2ec48c1ba0b3f964434360a in term 1.
I20260812 00:27:53.494494 5487 leader_election.cc:302] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169bd53867fb4cc588de51aa39601b49, 5ccf95ebd2ec48c1ba0b3f964434360a; no voters:
I20260812 00:27:53.494917 5682 raft_consensus.cc:2781] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:53.495618 5682 raft_consensus.cc:686] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 1 LEADER]: Becoming Leader. State: Replica: 5ccf95ebd2ec48c1ba0b3f964434360a, State: Running, Role: LEADER
I20260812 00:27:53.496165 5682 consensus_queue.cc:237] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } }
I20260812 00:27:53.501762 4957 catalog_manager.cc:5495] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccf95ebd2ec48c1ba0b3f964434360a (127.29.190.131). New cstate: current_term: 1 leader_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ccf95ebd2ec48c1ba0b3f964434360a" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45639 } health_report { overall_health: HEALTHY } } }
I20260812 00:27:53.533349 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.530134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33810 (local address 127.29.190.131:45639)
0812 00:27:53.530526 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.530531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.530909 (+ 378us) server_negotiation.cc:407] Connection header received
0812 00:27:53.531031 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.531035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.531129 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.531235 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.532436 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.532442 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.532445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.532466 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.532503 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.532517 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.532686 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.532893 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.532956 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
W20260812 00:27:53.534053 5650 tablet.cc:2369] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:53.543423 5389 raft_consensus.cc:1261] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 1 FOLLOWER]: Refusing update from remote peer 5ccf95ebd2ec48c1ba0b3f964434360a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:53.543475 5181 raft_consensus.cc:1261] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 1 FOLLOWER]: Refusing update from remote peer 5ccf95ebd2ec48c1ba0b3f964434360a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:27:53.545025 5685 consensus_queue.cc:1035] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [LEADER]: Connected to new peer: Peer: permanent_uuid: "43500cf6503d4d5ea7b21df3a1b17a6e" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 43723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:27:53.545449 5682 consensus_queue.cc:1035] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [LEADER]: Connected to new peer: Peer: permanent_uuid: "169bd53867fb4cc588de51aa39601b49" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:27:53.547886 5459 tablet.cc:2369] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:27:53.553964 5252 tablet.cc:2369] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:27:53.560266 5692 mvcc.cc:205] Tried to move back new op lower bound from 7317481363621666816 to 7317481363445407744. Current Snapshot: MvccSnapshot[applied={T|T < 7317481363621666816}]
I20260812 00:27:53.561775 5694 mvcc.cc:205] Tried to move back new op lower bound from 7317481363621666816 to 7317481363445407744. Current Snapshot: MvccSnapshot[applied={T|T < 7317481363621666816}]
I20260812 00:27:53.577251 4957 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60406:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:53.577622 4957 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60406:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:27:53.581967 4957 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64d1d4c899af4a279a32086a8e0c8fab: Sending DeleteTablet for 3 replicas of tablet 0133342edbb94e06bfaeb1aa367ec80c
I20260812 00:27:53.583595 5549 tablet_service.cc:1514] Processing DeleteTablet for tablet 0133342edbb94e06bfaeb1aa367ec80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:53 UTC) from {username='slave'} at 127.0.0.1:33794
I20260812 00:27:53.583580 5142 tablet_service.cc:1514] Processing DeleteTablet for tablet 0133342edbb94e06bfaeb1aa367ec80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:53 UTC) from {username='slave'} at 127.0.0.1:53334
I20260812 00:27:53.584880 5356 tablet_service.cc:1514] Processing DeleteTablet for tablet 0133342edbb94e06bfaeb1aa367ec80c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:27:53 UTC) from {username='slave'} at 127.0.0.1:60432
I20260812 00:27:53.585052 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 5045
I20260812 00:27:53.593717 5707 tablet_replica.cc:330] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: stopping tablet replica
I20260812 00:27:53.594300 5707 raft_consensus.cc:2229] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:53.594849 5705 tablet_replica.cc:330] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: stopping tablet replica
I20260812 00:27:53.594913 5707 raft_consensus.cc:2258] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:53.595700 5705 raft_consensus.cc:2229] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:27:53.596292 5705 raft_consensus.cc:2258] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:53.597496 5707 ts_tablet_manager.cc:1905] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:53.598537 5705 ts_tablet_manager.cc:1905] T 0133342edbb94e06bfaeb1aa367ec80c P 43500cf6503d4d5ea7b21df3a1b17a6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:53.598875 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.586727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53338 (local address 127.29.190.129:43723)
0812 00:27:53.586936 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.586943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.593558 (+ 6615us) server_negotiation.cc:407] Connection header received
0812 00:27:53.593809 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.593816 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.593940 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.594077 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.597716 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.597723 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.597728 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.597753 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.597799 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.597817 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.597942 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.598448 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.598530 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:27:53.600345 5246 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:53.601570 5704 tablet_replica.cc:330] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: stopping tablet replica
I20260812 00:27:53.602047 5704 raft_consensus.cc:2229] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:27:53.602764 5704 raft_consensus.cc:2258] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:27:53.605189 5704 ts_tablet_manager.cc:1905] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:27:53.606199 5707 ts_tablet_manager.cc:1918] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:27:53.606372 5707 log.cc:1196] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/0133342edbb94e06bfaeb1aa367ec80c
I20260812 00:27:53.606971 5707 ts_tablet_manager.cc:1939] T 0133342edbb94e06bfaeb1aa367ec80c P 169bd53867fb4cc588de51aa39601b49: Deleting consensus metadata
I20260812 00:27:53.609056 4927 catalog_manager.cc:4841] TS 169bd53867fb4cc588de51aa39601b49 (127.29.190.130:46365): tablet 0133342edbb94e06bfaeb1aa367ec80c (table test-table [id=b6b4acd2b5714c7ea3d04e06e19f1c0f]) successfully deleted
I20260812 00:27:53.614711 5704 ts_tablet_manager.cc:1918] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:27:53.614910 5704 log.cc:1196] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/0133342edbb94e06bfaeb1aa367ec80c
I20260812 00:27:53.615562 5704 ts_tablet_manager.cc:1939] T 0133342edbb94e06bfaeb1aa367ec80c P 5ccf95ebd2ec48c1ba0b3f964434360a: Deleting consensus metadata
I20260812 00:27:53.617982 4927 catalog_manager.cc:4841] TS 5ccf95ebd2ec48c1ba0b3f964434360a (127.29.190.131:45639): tablet 0133342edbb94e06bfaeb1aa367ec80c (table test-table [id=b6b4acd2b5714c7ea3d04e06e19f1c0f]) successfully deleted
I20260812 00:27:53.716316 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 5045
W20260812 00:27:53.746042 4925 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.190.129:43723 (error 108)
I20260812 00:27:53.746567 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 5258
I20260812 00:27:53.748762 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.748243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53346)
0812 00:27:53.748413 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.748567 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 00:27:53.749075 4925 catalog_manager.cc:4584] TS 43500cf6503d4d5ea7b21df3a1b17a6e (127.29.190.129:43723): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0133342edbb94e06bfaeb1aa367ec80c: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
I20260812 00:27:53.750554 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.747960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60446 (local address 127.29.190.130:46365)
0812 00:27:53.748148 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.748154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.748176 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:27:53.748656 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.748663 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.748780 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.748891 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.749997 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.750002 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.750005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.750021 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.750053 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.750065 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.750172 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.750299 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.750348 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:27:53.751374 5448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:53.803331 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.802712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53360)
0812 00:27:53.802998 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.803142 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260812 00:27:53.804716 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.804208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53376)
0812 00:27:53.804389 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.804535 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 00:27:53.845335 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 5258
I20260812 00:27:53.865238 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.864779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53392)
0812 00:27:53.864985 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.865085 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 00:27:53.866338 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.865987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53400)
0812 00:27:53.866142 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.866221 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 00:27:53.880092 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 5461
I20260812 00:27:53.883513 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.880998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33824 (local address 127.29.190.131:45639)
0812 00:27:53.881181 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:53.881185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:53.881258 (+ 73us) server_negotiation.cc:407] Connection header received
0812 00:27:53.881492 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:53.881497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:53.881558 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:53.881648 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:53.882679 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:53.882685 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:53.882688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:53.882705 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:53.882742 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:53.882754 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:53.882877 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:53.883035 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:27:53.883090 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:27:53.884225 5637 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:53.947343 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.946826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53410)
0812 00:27:53.947073 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.947172 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260812 00:27:53.948594 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:53.948137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53416)
0812 00:27:53.948365 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:53.948442 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260812 00:27:54.009523 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 5461
I20260812 00:27:54.038234 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 4902
I20260812 00:27:54.039863 5002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:54.150904 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:54.150242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:43723 (local address 127.0.0.1:53426)
0812 00:27:54.150537 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:54.150711 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:43723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 00:27:54.150944 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 4902
2026-08-12T00:27:54Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3018 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 00:27:54.205165 30458 mini_oidc.cc:152] Starting JWKS server
I20260812 00:27:54.208092 30458 webserver.cc:460] Webserver started at https://127.0.0.1:40293/ using document root <none> and password file <none>
I20260812 00:27:54.208526 30458 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:27:54.209184 30458 webserver.cc:460] Webserver started at http://127.0.0.1:43155/ using document root <none> and password file <none>
2026-08-12T00:27:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:54Z Disabled control of system clock
I20260812 00:27:54.243531 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:45279
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:45279
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40293/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/testchainca.cert with env {}
W20260812 00:27:54.605322 5726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:54.605645 5726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:54.605798 5726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:54.613554 5726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:54.613673 5726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:54.613742 5726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:54.613832 5726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:54.613924 5726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:27:54.614041 5726 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:27:54.614097 5726 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40293/jwks.json
I20260812 00:27:54.624490 5726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:45279
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:45279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40293/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:54.625903 5726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:54.627961 5726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:54.640991 5736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:54.641010 5734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:54.641234 5733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:54.641940 5726 server_base.cc:1034] running on GCE node
I20260812 00:27:54.642808 5726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:54.644348 5726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:54.645577 5726 hybrid_clock.cc:648] HybridClock initialized: now 1786494474645537 us; error 39 us; skew 500 ppm
I20260812 00:27:54.645903 5726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:54.648233 5726 webserver.cc:460] Webserver started at http://127.29.190.190:34277/ using document root <none> and password file <none>
I20260812 00:27:54.648903 5726 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:54.649005 5726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:54.649307 5726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:54.654276 5726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b"
format_stamp: "Formatted at 2026-08-12 00:27:54 on dist-test-slave-c12x"
server_key: "632bac592778f672af3bc4a261ceecbb"
server_key_iv: "21eae2a7e4a3349f436bb0f51412d5e4"
server_key_version: "encryptionkey@0"
I20260812 00:27:54.655067 5726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b"
format_stamp: "Formatted at 2026-08-12 00:27:54 on dist-test-slave-c12x"
server_key: "632bac592778f672af3bc4a261ceecbb"
server_key_iv: "21eae2a7e4a3349f436bb0f51412d5e4"
server_key_version: "encryptionkey@0"
I20260812 00:27:54.660633 5726 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:27:54.664474 5743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:54.666103 5726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:27:54.666325 5726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b"
format_stamp: "Formatted at 2026-08-12 00:27:54 on dist-test-slave-c12x"
server_key: "632bac592778f672af3bc4a261ceecbb"
server_key_iv: "21eae2a7e4a3349f436bb0f51412d5e4"
server_key_version: "encryptionkey@0"
I20260812 00:27:54.666610 5726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:54.693574 5726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:54.694561 5726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:54.694937 5726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:54.716981 5726 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:45279
I20260812 00:27:54.717006 5818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:45279 every 8 connection(s)
I20260812 00:27:54.718621 5726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:54.722734 5819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:54.727205 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 5726
I20260812 00:27:54.727545 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:54.728310 30458 external_mini_cluster.cc:1428] Setting key 490186730d52dc588511ee884be4c691
I20260812 00:27:54.734458 5819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b: Bootstrap starting.
I20260812 00:27:54.738445 5819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:54.739873 5819 log.cc:824] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:54.743542 5819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b: No bootstrap required, opened a new log
I20260812 00:27:54.744628 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:54.730704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56596 (local address 127.29.190.190:45279)
0812 00:27:54.732113 (+ 1409us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:54.732126 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:54.732177 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:27:54.734172 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:54.734197 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:54.734802 (+ 605us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:54.735175 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:54.735928 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:54.737360 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:54.739389 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:54.740364 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:54.740670 (+ 306us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:54.741976 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:54.741984 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:54.742001 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:54.742616 (+ 615us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:54.742700 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:54.742725 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:54.742838 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:54.743114 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 00:27:54.743537 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":860,"thread_start_us":497,"threads_started":1}
I20260812 00:27:54.748930 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:27:54.751871 5819 raft_consensus.cc:348] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45279 } }
I20260812 00:27:54.752256 5819 raft_consensus.cc:374] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:54.752429 5819 raft_consensus.cc:729] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e710d1ac2e9b4fdc9c74d3b7d15ffe7b, State: Initialized, Role: FOLLOWER
I20260812 00:27:54.753090 5819 consensus_queue.cc:260] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45279 } }
I20260812 00:27:54.753335 5819 raft_consensus.cc:388] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:54.753471 5819 raft_consensus.cc:482] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:54.753664 5819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:54.756050 5819 raft_consensus.cc:504] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45279 } }
I20260812 00:27:54.756603 5819 leader_election.cc:302] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e710d1ac2e9b4fdc9c74d3b7d15ffe7b; no voters:
I20260812 00:27:54.757261 5819 leader_election.cc:288] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:54.757498 5825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:54.758641 5825 raft_consensus.cc:686] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [term 1 LEADER]: Becoming Leader. State: Replica: e710d1ac2e9b4fdc9c74d3b7d15ffe7b, State: Running, Role: LEADER
I20260812 00:27:54.759231 5825 consensus_queue.cc:237] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45279 } }
I20260812 00:27:54.759920 5819 sys_catalog.cc:564] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:54.762962 5827 sys_catalog.cc:455] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e710d1ac2e9b4fdc9c74d3b7d15ffe7b. Latest consensus state: current_term: 1 leader_uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45279 } } }
I20260812 00:27:54.763087 5826 sys_catalog.cc:455] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e710d1ac2e9b4fdc9c74d3b7d15ffe7b" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45279 } } }
I20260812 00:27:54.763958 5827 sys_catalog.cc:458] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:54.763971 5826 sys_catalog.cc:458] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:54.767011 5835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:54.772547 5835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:54.782585 5835 catalog_manager.cc:1347] Generated new cluster ID: 8594e30d0e8c473790dda5d5f358b7d1
I20260812 00:27:54.782732 5835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:54.805295 5835 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:54.807046 5835 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:54.817813 5835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e710d1ac2e9b4fdc9c74d3b7d15ffe7b: Generated new TSK 0
I20260812 00:27:54.818894 5835 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:27:54.873703 5863 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 00:27:54.873979 5863 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:27:54.876305 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:54.850305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56612 (local address 127.29.190.190:45279)
0812 00:27:54.850561 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:54.850567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:54.851026 (+ 459us) server_negotiation.cc:407] Connection header received
0812 00:27:54.851575 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:54.851580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:54.851657 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:54.851785 (+ 128us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:27:54.852572 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:54.853300 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:54.855724 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:54.856190 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:54.856292 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:54.857012 (+ 720us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:27:54.875510 (+ 18498us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:27:54.875951 (+ 441us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56612: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":88}
W20260812 00:27:54.876444 5823 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56612: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 00:27:54.877904 5861 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:54.850136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:45279 (local address 127.0.0.1:56612)
0812 00:27:54.850896 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:54.850920 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:54.851146 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:54.851856 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:54.851862 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:54.851878 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:27:54.852347 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:54.852361 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:54.853462 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:54.853469 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:54.855558 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:54.855576 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:54.856393 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:54.856400 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:54.856614 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:54.856710 (+ 96us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:27:54.875852 (+ 19142us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 00:27:54.876164 (+ 312us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.190.190:45279: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":358,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.29.190.190:45279: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 00:27:54.879599 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 5726
I20260812 00:27:54.881232 5812 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:54.981477 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 5726
2026-08-12T00:27:55Z chronyd exiting
I20260812 00:27:55.044924 30458 test_util.cc:175] -----------------------------------------------
I20260812 00:27:55.045080 30458 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786494426716583-30458-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (844 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 00:27:55.049551 30458 mini_oidc.cc:152] Starting JWKS server
I20260812 00:27:55.051697 30458 webserver.cc:460] Webserver started at https://127.0.0.1:38859/ using document root <none> and password file <none>
I20260812 00:27:55.051957 30458 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:27:55.052798 30458 webserver.cc:460] Webserver started at http://127.0.0.1:37663/ using document root <none> and password file <none>
2026-08-12T00:27:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:55Z Disabled control of system clock
I20260812 00:27:55.089658 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:40681
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:37901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:40681
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38859/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/testchainca.cert with env {}
W20260812 00:27:55.452667 5873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:55.453075 5873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:55.453223 5873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:55.460784 5873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:55.460917 5873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:55.460958 5873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:55.461009 5873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:55.461055 5873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:27:55.461114 5873 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:27:55.461156 5873 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38859/jwks.json
I20260812 00:27:55.471638 5873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:40681
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:40681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38859/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:55.473021 5873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:55.474521 5873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:55.487908 5885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:55.487906 5880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:55.488154 5879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:55.488983 5873 server_base.cc:1034] running on GCE node
I20260812 00:27:55.489919 5873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:55.491552 5873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:55.492808 5873 hybrid_clock.cc:648] HybridClock initialized: now 1786494475492754 us; error 42 us; skew 500 ppm
I20260812 00:27:55.493214 5873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:55.501055 5873 webserver.cc:460] Webserver started at http://127.29.190.190:37545/ using document root <none> and password file <none>
I20260812 00:27:55.501927 5873 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:55.502097 5873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:55.502477 5873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:55.506107 5873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13"
format_stamp: "Formatted at 2026-08-12 00:27:55 on dist-test-slave-c12x"
server_key: "19ed18d051f4f52967f9672952e1d4db"
server_key_iv: "372f3804de14e196f7612fddfc869c28"
server_key_version: "encryptionkey@0"
I20260812 00:27:55.507000 5873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13"
format_stamp: "Formatted at 2026-08-12 00:27:55 on dist-test-slave-c12x"
server_key: "19ed18d051f4f52967f9672952e1d4db"
server_key_iv: "372f3804de14e196f7612fddfc869c28"
server_key_version: "encryptionkey@0"
I20260812 00:27:55.512986 5873 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:27:55.517499 5892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:55.519145 5873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:27:55.519363 5873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13"
format_stamp: "Formatted at 2026-08-12 00:27:55 on dist-test-slave-c12x"
server_key: "19ed18d051f4f52967f9672952e1d4db"
server_key_iv: "372f3804de14e196f7612fddfc869c28"
server_key_version: "encryptionkey@0"
I20260812 00:27:55.519693 5873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:55.535632 5873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:55.536564 5873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:55.536918 5873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:55.558487 5873 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:40681
I20260812 00:27:55.558432 5976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:40681 every 8 connection(s)
I20260812 00:27:55.560084 5873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:55.564464 5977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:55.565953 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 5873
I20260812 00:27:55.566184 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:55.567236 30458 external_mini_cluster.cc:1428] Setting key 33c732fa7bdedf034dd34d0378cbfef1
I20260812 00:27:55.580334 5977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13: Bootstrap starting.
I20260812 00:27:55.581692 5983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:55.569615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37966 (local address 127.29.190.190:40681)
0812 00:27:55.570814 (+ 1199us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:55.570826 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:55.570875 (+ 49us) server_negotiation.cc:407] Connection header received
0812 00:27:55.572659 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:55.572684 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:55.573211 (+ 527us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:55.573655 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:55.574268 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:55.575641 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:55.576941 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:55.577681 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:55.577926 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:55.579157 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:55.579165 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:55.579179 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:55.579808 (+ 629us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:55.579889 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:55.579912 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:55.580061 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:55.580283 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 00:27:55.580652 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":743,"thread_start_us":422,"threads_started":1}
I20260812 00:27:55.583998 5977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:55.585284 5977 log.cc:824] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:55.585839 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:27:55.588845 5977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13: No bootstrap required, opened a new log
I20260812 00:27:55.597525 5977 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40681 } }
I20260812 00:27:55.598002 5977 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:55.598129 5977 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cbe2041400e4bb99ea4dc5a8a4eec13, State: Initialized, Role: FOLLOWER
I20260812 00:27:55.598848 5977 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40681 } }
I20260812 00:27:55.599200 5977 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:55.599362 5977 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:55.599579 5977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:55.601898 5977 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40681 } }
I20260812 00:27:55.602510 5977 leader_election.cc:302] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cbe2041400e4bb99ea4dc5a8a4eec13; no voters:
I20260812 00:27:55.603185 5977 leader_election.cc:288] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:55.603375 5985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:55.604985 5985 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [term 1 LEADER]: Becoming Leader. State: Replica: 2cbe2041400e4bb99ea4dc5a8a4eec13, State: Running, Role: LEADER
I20260812 00:27:55.605592 5985 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40681 } }
I20260812 00:27:55.606052 5977 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:55.608538 5986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40681 } } }
I20260812 00:27:55.609165 5986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:55.608719 5987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cbe2041400e4bb99ea4dc5a8a4eec13. Latest consensus state: current_term: 1 leader_uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cbe2041400e4bb99ea4dc5a8a4eec13" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40681 } } }
I20260812 00:27:55.610204 5987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:55.611304 5996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:55.617092 5996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:55.627847 5996 catalog_manager.cc:1347] Generated new cluster ID: dc3a2381e6254b978fa2c8dac7028452
I20260812 00:27:55.628012 5996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:55.666210 5996 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:55.667755 5996 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:55.678603 5996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cbe2041400e4bb99ea4dc5a8a4eec13: Generated new TSK 0
I20260812 00:27:55.679744 5996 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 00:27:55.714293 6024 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 00:27:55.714468 6024 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:27:55.715975 5983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:55.695281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37970 (local address 127.29.190.190:40681)
0812 00:27:55.695565 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:55.695573 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:55.696020 (+ 447us) server_negotiation.cc:407] Connection header received
0812 00:27:55.696303 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:55.696307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:55.696390 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:55.696594 (+ 204us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:27:55.697111 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:55.697870 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:55.699317 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:55.699879 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:55.700033 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:55.700550 (+ 517us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:27:55.715069 (+ 14519us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38859/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:27:55.715599 (+ 530us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37970: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38859/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 00:27:55.716135 5983 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37970: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38859/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 00:27:55.716168 6023 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:55.695206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:40681 (local address 127.0.0.1:37970)
0812 00:27:55.695879 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:55.695918 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:55.696103 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:55.696622 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:55.696627 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:55.696640 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:27:55.696944 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:55.696955 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:55.698033 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:55.698043 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:55.699137 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:55.699150 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:55.700061 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:55.700068 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:55.700238 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:55.700272 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:27:55.715372 (+ 15100us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38859/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 00:27:55.715709 (+ 337us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.190.190:40681: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38859/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":407,"threads_started":1}
I20260812 00:27:55.717844 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 5873
I20260812 00:27:55.719247 5967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:55.819274 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 5873
2026-08-12T00:27:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (838 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 00:27:55.887820 30458 mini_oidc.cc:152] Starting JWKS server
I20260812 00:27:55.889843 30458 webserver.cc:460] Webserver started at https://127.0.0.1:36561/ using document root <none> and password file <none>
I20260812 00:27:55.890159 30458 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 00:27:55.890905 30458 webserver.cc:460] Webserver started at http://127.0.0.1:46283/ using document root <none> and password file <none>
2026-08-12T00:27:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:55Z Disabled control of system clock
I20260812 00:27:55.927963 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:34511
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:34801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:34511
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36561/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:27:56.286353 6034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:56.286758 6034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:56.286942 6034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:56.294915 6034 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:56.295092 6034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:56.295193 6034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:56.295305 6034 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:56.295385 6034 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:27:56.295513 6034 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:27:56.295578 6034 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36561/jwks.json
I20260812 00:27:56.305290 6034 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:34511
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:34511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36561/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:56.306799 6034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:56.308771 6034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:56.321448 6042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:56.321480 6044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:56.321527 6047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:56.322443 6034 server_base.cc:1034] running on GCE node
I20260812 00:27:56.323355 6034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:56.325035 6034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:56.326289 6034 hybrid_clock.cc:648] HybridClock initialized: now 1786494476326249 us; error 61 us; skew 500 ppm
I20260812 00:27:56.326699 6034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:56.329530 6034 webserver.cc:460] Webserver started at http://127.29.190.190:44903/ using document root <none> and password file <none>
I20260812 00:27:56.330771 6034 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:56.330937 6034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:56.331308 6034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:56.334646 6034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "516d49bb180a41ea9a2fbf19e497a5a8"
format_stamp: "Formatted at 2026-08-12 00:27:56 on dist-test-slave-c12x"
server_key: "8a9d62836adf2f99c0c4cf3804dfef1e"
server_key_iv: "8aad13266d7b1131932c41d6670c6705"
server_key_version: "encryptionkey@0"
I20260812 00:27:56.335640 6034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "516d49bb180a41ea9a2fbf19e497a5a8"
format_stamp: "Formatted at 2026-08-12 00:27:56 on dist-test-slave-c12x"
server_key: "8a9d62836adf2f99c0c4cf3804dfef1e"
server_key_iv: "8aad13266d7b1131932c41d6670c6705"
server_key_version: "encryptionkey@0"
I20260812 00:27:56.342105 6034 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:27:56.346258 6054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:56.347997 6034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:27:56.348239 6034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "516d49bb180a41ea9a2fbf19e497a5a8"
format_stamp: "Formatted at 2026-08-12 00:27:56 on dist-test-slave-c12x"
server_key: "8a9d62836adf2f99c0c4cf3804dfef1e"
server_key_iv: "8aad13266d7b1131932c41d6670c6705"
server_key_version: "encryptionkey@0"
I20260812 00:27:56.348584 6034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:56.363293 6034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:56.364276 6034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:56.364645 6034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:56.387166 6034 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:34511
I20260812 00:27:56.387185 6133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:34511 every 8 connection(s)
I20260812 00:27:56.388959 6034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:56.393024 6134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:56.394466 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 6034
I20260812 00:27:56.394698 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:56.395414 30458 external_mini_cluster.cc:1428] Setting key a0b748a940f505b3eaeee5122ef5c534
I20260812 00:27:56.407909 6134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8: Bootstrap starting.
I20260812 00:27:56.410638 6137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:56.397553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49486 (local address 127.29.190.190:34511)
0812 00:27:56.398700 (+ 1147us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:56.398715 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:56.398773 (+ 58us) server_negotiation.cc:407] Connection header received
0812 00:27:56.400556 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:56.400586 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:56.401194 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:56.401622 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:56.402149 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:56.404178 (+ 2029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:56.405763 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:56.406827 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:56.407010 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:56.408279 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:56.408287 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:56.408301 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:56.408862 (+ 561us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:56.408954 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:56.408977 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:56.409133 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:56.409386 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 00:27:56.409706 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":373,"threads_started":1}
I20260812 00:27:56.411360 6134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:56.412514 6134 log.cc:824] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:56.414705 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:27:56.415867 6134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8: No bootstrap required, opened a new log
I20260812 00:27:56.424837 6134 raft_consensus.cc:348] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516d49bb180a41ea9a2fbf19e497a5a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34511 } }
I20260812 00:27:56.425280 6134 raft_consensus.cc:374] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:56.425395 6134 raft_consensus.cc:729] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 516d49bb180a41ea9a2fbf19e497a5a8, State: Initialized, Role: FOLLOWER
I20260812 00:27:56.425980 6134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516d49bb180a41ea9a2fbf19e497a5a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34511 } }
I20260812 00:27:56.426247 6134 raft_consensus.cc:388] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:56.426404 6134 raft_consensus.cc:482] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:56.426606 6134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:56.429116 6134 raft_consensus.cc:504] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516d49bb180a41ea9a2fbf19e497a5a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34511 } }
I20260812 00:27:56.429687 6134 leader_election.cc:302] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 516d49bb180a41ea9a2fbf19e497a5a8; no voters:
I20260812 00:27:56.430361 6134 leader_election.cc:288] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:56.430612 6139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:56.431463 6139 raft_consensus.cc:686] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [term 1 LEADER]: Becoming Leader. State: Replica: 516d49bb180a41ea9a2fbf19e497a5a8, State: Running, Role: LEADER
I20260812 00:27:56.432042 6139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516d49bb180a41ea9a2fbf19e497a5a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34511 } }
I20260812 00:27:56.432726 6134 sys_catalog.cc:564] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:56.435674 6141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 516d49bb180a41ea9a2fbf19e497a5a8. Latest consensus state: current_term: 1 leader_uuid: "516d49bb180a41ea9a2fbf19e497a5a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516d49bb180a41ea9a2fbf19e497a5a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34511 } } }
I20260812 00:27:56.435667 6140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "516d49bb180a41ea9a2fbf19e497a5a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516d49bb180a41ea9a2fbf19e497a5a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34511 } } }
I20260812 00:27:56.436236 6140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:56.436236 6141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:56.441087 6145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:56.448186 6145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:56.458281 6145 catalog_manager.cc:1347] Generated new cluster ID: 9359f6ae1e134d5ca30ec077d6262377
I20260812 00:27:56.458446 6145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:56.471489 6145 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:56.472910 6145 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:56.485987 6145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 516d49bb180a41ea9a2fbf19e497a5a8: Generated new TSK 0
I20260812 00:27:56.486982 6145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:27:56.512804 6137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:56.503057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49488 (local address 127.29.190.190:34511)
0812 00:27:56.503280 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:56.503289 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:56.504000 (+ 711us) server_negotiation.cc:407] Connection header received
0812 00:27:56.504271 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:56.504277 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:56.504397 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:56.504581 (+ 184us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:27:56.505255 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:56.506383 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:56.507985 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:56.508699 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:56.508841 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:56.509422 (+ 581us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:27:56.512098 (+ 2676us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36561/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:27:56.512465 (+ 367us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36561/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 00:27:56.512954 6137 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36561/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 00:27:56.514611 6173 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:56.503029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34511 (local address 127.0.0.1:49488)
0812 00:27:56.503874 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:56.503896 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:56.504049 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:56.504669 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:56.504673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:56.504686 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:27:56.505069 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:56.505080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:56.506576 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:56.506581 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:56.507831 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:56.507844 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:56.508906 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:56.508912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:56.509058 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:56.509095 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:27:56.512330 (+ 3235us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36561/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 00:27:56.514172 (+ 1842us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.190.190:34511: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36561/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":677,"mutex_wait_us":1484,"thread_start_us":494,"threads_started":1}
I20260812 00:27:56.515867 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 6034
I20260812 00:27:56.517405 6122 generic_service.cc:196] Checking for leaks (request via RPC)
E20260812 00:27:56.525530 6174 webserver.cc:533] Webserver: sslize failed:
E20260812 00:27:56.525662 6174 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 00:27:56.630451 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 6034
2026-08-12T00:27:56Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (820 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T00:27:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:27:56Z Disabled control of system clock
I20260812 00:27:56.745461 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:34185
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:34185
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/testchainca.cert with env {}
W20260812 00:27:57.107580 6180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:27:57.107993 6180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:27:57.108160 6180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:27:57.115736 6180 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:27:57.115869 6180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:27:57.115909 6180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:27:57.115962 6180 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:27:57.116008 6180 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 00:27:57.116074 6180 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 00:27:57.116117 6180 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 00:27:57.126536 6180 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:34185
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:34185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:27:57.127951 6180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:27:57.129400 6180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:27:57.142727 6188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:57.142699 6193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:27:57.142807 6190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:27:57.144153 6180 server_base.cc:1034] running on GCE node
I20260812 00:27:57.145130 6180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:27:57.146715 6180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:27:57.147950 6180 hybrid_clock.cc:648] HybridClock initialized: now 1786494477147880 us; error 70 us; skew 500 ppm
I20260812 00:27:57.148326 6180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:27:57.150743 6180 webserver.cc:460] Webserver started at http://127.29.190.190:37587/ using document root <none> and password file <none>
I20260812 00:27:57.151564 6180 fs_manager.cc:359] Metadata directory not provided
I20260812 00:27:57.151708 6180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:27:57.152060 6180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:27:57.155045 6180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "4ffe79059b73491188b701b1c285d696"
format_stamp: "Formatted at 2026-08-12 00:27:57 on dist-test-slave-c12x"
server_key: "91d77c8d96fc0df69ece3f57b0c485f4"
server_key_iv: "1d1f3442230bc22d4d91186cb1722f98"
server_key_version: "encryptionkey@0"
I20260812 00:27:57.155925 6180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "4ffe79059b73491188b701b1c285d696"
format_stamp: "Formatted at 2026-08-12 00:27:57 on dist-test-slave-c12x"
server_key: "91d77c8d96fc0df69ece3f57b0c485f4"
server_key_iv: "1d1f3442230bc22d4d91186cb1722f98"
server_key_version: "encryptionkey@0"
I20260812 00:27:57.161299 6180 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 00:27:57.165081 6201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:27:57.166566 6180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 00:27:57.166770 6180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "4ffe79059b73491188b701b1c285d696"
format_stamp: "Formatted at 2026-08-12 00:27:57 on dist-test-slave-c12x"
server_key: "91d77c8d96fc0df69ece3f57b0c485f4"
server_key_iv: "1d1f3442230bc22d4d91186cb1722f98"
server_key_version: "encryptionkey@0"
I20260812 00:27:57.167011 6180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:27:57.183041 6180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:27:57.184013 6180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:27:57.184324 6180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:27:57.204190 6180 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:34185
I20260812 00:27:57.204212 6275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:34185 every 8 connection(s)
I20260812 00:27:57.205713 6180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:27:57.209791 6279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:27:57.210489 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 6180
I20260812 00:27:57.210721 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:27:57.211417 30458 external_mini_cluster.cc:1428] Setting key bbfd56a7bcd627dcb4e4157d9aeeafde
I20260812 00:27:57.224243 6279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696: Bootstrap starting.
I20260812 00:27:57.226425 6282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:57.213594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42536 (local address 127.29.190.190:34185)
0812 00:27:57.214742 (+ 1148us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:57.214753 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:57.214801 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:27:57.216515 (+ 1714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:57.216547 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:57.217046 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:57.217391 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:27:57.218031 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:57.219335 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:57.221359 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:57.222111 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:57.222267 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:57.223701 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:27:57.223709 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:27:57.223725 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:27:57.224332 (+ 607us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:27:57.224475 (+ 143us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:27:57.224503 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:27:57.224618 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 00:27:57.224917 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 00:27:57.225320 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":408,"threads_started":1}
I20260812 00:27:57.227743 6279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696: Neither blocks nor log segments found. Creating new log.
I20260812 00:27:57.229055 6279 log.cc:824] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696: Log is configured to *not* fsync() on all Append() calls
I20260812 00:27:57.230840 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:27:57.232848 6279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696: No bootstrap required, opened a new log
I20260812 00:27:57.242990 6279 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffe79059b73491188b701b1c285d696" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34185 } }
I20260812 00:27:57.243415 6279 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:27:57.243584 6279 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ffe79059b73491188b701b1c285d696, State: Initialized, Role: FOLLOWER
I20260812 00:27:57.244141 6279 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffe79059b73491188b701b1c285d696" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34185 } }
I20260812 00:27:57.244370 6279 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:27:57.244482 6279 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:27:57.244637 6279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:27:57.247262 6279 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffe79059b73491188b701b1c285d696" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34185 } }
I20260812 00:27:57.247956 6279 leader_election.cc:302] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ffe79059b73491188b701b1c285d696; no voters:
I20260812 00:27:57.248667 6279 leader_election.cc:288] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:27:57.248858 6284 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:27:57.249727 6284 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [term 1 LEADER]: Becoming Leader. State: Replica: 4ffe79059b73491188b701b1c285d696, State: Running, Role: LEADER
I20260812 00:27:57.250398 6284 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffe79059b73491188b701b1c285d696" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34185 } }
I20260812 00:27:57.251161 6279 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:27:57.253854 6286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ffe79059b73491188b701b1c285d696" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffe79059b73491188b701b1c285d696" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34185 } } }
I20260812 00:27:57.253832 6287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ffe79059b73491188b701b1c285d696. Latest consensus state: current_term: 1 leader_uuid: "4ffe79059b73491188b701b1c285d696" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ffe79059b73491188b701b1c285d696" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 34185 } } }
I20260812 00:27:57.254357 6286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:57.254398 6287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696 [sys.catalog]: This master's current role is: LEADER
I20260812 00:27:57.256330 6291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:27:57.261922 6291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:27:57.272759 6291 catalog_manager.cc:1347] Generated new cluster ID: ec02cf247eaa4526a0907081ce32455d
I20260812 00:27:57.272938 6291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:27:57.288692 6291 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:27:57.290068 6291 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:27:57.300943 6291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ffe79059b73491188b701b1c285d696: Generated new TSK 0
I20260812 00:27:57.302176 6291 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:27:57.395329 6282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:27:57.324136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42544 (local address 127.29.190.190:34185)
0812 00:27:57.324359 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:27:57.324368 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:27:57.324763 (+ 395us) server_negotiation.cc:407] Connection header received
0812 00:27:57.325072 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:27:57.325080 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:27:57.325157 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:27:57.325336 (+ 179us) server_negotiation.cc:226] Negotiated authn=JWT
0812 00:27:57.325837 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:57.326609 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:57.328137 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:27:57.328599 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:27:57.328758 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:57.329319 (+ 561us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 00:27:57.394481 (+ 65162us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:27:57.394983 (+ 502us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42544: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 00:27:57.395606 6320 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:27:57.324028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:34185 (local address 127.0.0.1:42544)
0812 00:27:57.324644 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0812 00:27:57.324661 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:27:57.324840 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:27:57.325352 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:27:57.325358 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:27:57.325371 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0812 00:27:57.325658 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:57.325668 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:57.326784 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:57.326795 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:57.327974 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:27:57.327989 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:27:57.328808 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:27:57.328817 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:27:57.328964 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:27:57.329002 (+ 38us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 00:27:57.394810 (+ 65808us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 00:27:57.395137 (+ 327us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.190.190:34185: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":318,"threads_started":1}
W20260812 00:27:57.395634 6282 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42544: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260812 00:27:57.396862 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 6180
I20260812 00:27:57.398147 6270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:27:57.503849 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 6180
2026-08-12T00:27:57Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (844 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (466 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1704 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:27:59 dist-test-slave-c12x krb5kdc[6340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:27:59 dist-test-slave-c12x krb5kdc[6340](info): set up 2 sockets
Aug 12 00:27:59 dist-test-slave-c12x krb5kdc[6340](info): commencing operation
krb5kdc: starting...
W20260812 00:28:01.039721 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.002s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:28:01 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:28:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:28:01.296974 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:35089
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:35089
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:01.653030 6360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:01.653401 6360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:01.653582 6360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:01.662551 6360 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:01.662724 6360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:01.662819 6360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:01.662905 6360 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:01.663002 6360 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:01.673517 6360 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:35089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:35089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:01.675048 6360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:01.676491 6360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:01.689771 6372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:01.689924 6368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:01.689898 6369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:01.690860 6360 server_base.cc:1034] running on GCE node
I20260812 00:28:01.691968 6360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:01.693543 6360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:01.694826 6360 hybrid_clock.cc:648] HybridClock initialized: now 1786494481694780 us; error 50 us; skew 500 ppm
I20260812 00:28:01.695240 6360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:01 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494481, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:01.701915 6360 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:28:01.703922 6360 webserver.cc:460] Webserver started at http://127.29.190.190:41821/ using document root <none> and password file <none>
I20260812 00:28:01.704679 6360 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:01.704795 6360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:01.705093 6360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:01.708519 6360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "10033c7b30fd411484c21f02cb9ca463"
format_stamp: "Formatted at 2026-08-12 00:28:01 on dist-test-slave-c12x"
server_key: "b4a511a8266ed284834b3426625a6db9"
server_key_iv: "99ffd075c4a980dbba9dffcd4f405646"
server_key_version: "encryptionkey@0"
I20260812 00:28:01.709378 6360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "10033c7b30fd411484c21f02cb9ca463"
format_stamp: "Formatted at 2026-08-12 00:28:01 on dist-test-slave-c12x"
server_key: "b4a511a8266ed284834b3426625a6db9"
server_key_iv: "99ffd075c4a980dbba9dffcd4f405646"
server_key_version: "encryptionkey@0"
I20260812 00:28:01.715245 6360 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:28:01.719086 6384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:01.720588 6360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:01.720784 6360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "10033c7b30fd411484c21f02cb9ca463"
format_stamp: "Formatted at 2026-08-12 00:28:01 on dist-test-slave-c12x"
server_key: "b4a511a8266ed284834b3426625a6db9"
server_key_iv: "99ffd075c4a980dbba9dffcd4f405646"
server_key_version: "encryptionkey@0"
I20260812 00:28:01.720991 6360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:01.742858 6360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:01.747499 6360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:01.747819 6360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:01.768348 6360 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:35089
I20260812 00:28:01.768397 6460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:35089 every 8 connection(s)
I20260812 00:28:01.769886 6360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:28:01.773834 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 6360
I20260812 00:28:01.774041 6461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:01.774080 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:28:01.774776 30458 external_mini_cluster.cc:1428] Setting key 9e8f3b820c44f8aea9611e0c48704793
I20260812 00:28:01.789695 6461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463: Bootstrap starting.
Aug 12 00:28:01 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:01.793512 6461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:01.794842 6461 log.cc:824] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:01.798353 6461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463: No bootstrap required, opened a new log
I20260812 00:28:01.803344 6464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:01.776916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56938 (local address 127.29.190.190:35089)
0812 00:28:01.777871 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:01.777889 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:01.777944 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:28:01.781093 (+ 3149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:01.781130 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:01.781739 (+ 609us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:01.782267 (+ 528us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:01.784179 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:01.786331 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:01.787899 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:01.789012 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:01.789254 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:01.793933 (+ 4679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:01.793943 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:01.793965 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:01.794020 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:01.797826 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:01.798861 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:01.798870 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:01.798882 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:01.799108 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:01.799691 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:01.799695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:01.799698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:01.800531 (+ 833us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:01.800972 (+ 441us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:01.801501 (+ 529us) server_negotiation.cc:299] Negotiation successful
0812 00:28:01.802026 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":689,"thread_start_us":405,"threads_started":1}
I20260812 00:28:01.807770 6461 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10033c7b30fd411484c21f02cb9ca463" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35089 } }
I20260812 00:28:01.808188 6461 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:01.808302 6461 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10033c7b30fd411484c21f02cb9ca463, State: Initialized, Role: FOLLOWER
I20260812 00:28:01.808894 6461 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10033c7b30fd411484c21f02cb9ca463" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35089 } }
I20260812 00:28:01.809175 6461 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:28:01.809342 6461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:28:01.809566 6461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:01.812278 6461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10033c7b30fd411484c21f02cb9ca463" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35089 } }
I20260812 00:28:01.812836 6461 leader_election.cc:302] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10033c7b30fd411484c21f02cb9ca463; no voters:
I20260812 00:28:01.813514 6461 leader_election.cc:288] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:28:01.813692 6469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:01.814538 6469 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [term 1 LEADER]: Becoming Leader. State: Replica: 10033c7b30fd411484c21f02cb9ca463, State: Running, Role: LEADER
I20260812 00:28:01.815151 6469 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10033c7b30fd411484c21f02cb9ca463" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35089 } }
I20260812 00:28:01.815920 6461 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:01.818776 6470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10033c7b30fd411484c21f02cb9ca463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10033c7b30fd411484c21f02cb9ca463" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35089 } } }
I20260812 00:28:01.819288 6470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:01.824704 6471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10033c7b30fd411484c21f02cb9ca463. Latest consensus state: current_term: 1 leader_uuid: "10033c7b30fd411484c21f02cb9ca463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10033c7b30fd411484c21f02cb9ca463" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35089 } } }
I20260812 00:28:01.825759 6471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:01.828343 6485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:01.833241 6485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:01.842406 6485 catalog_manager.cc:1347] Generated new cluster ID: 34a186356f0b4e2cb864f23036127afa
I20260812 00:28:01.842561 6485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:01.859520 6485 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:28:01.860972 6485 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:01.869820 6485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10033c7b30fd411484c21f02cb9ca463: Generated new TSK 0
I20260812 00:28:01.870836 6485 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:28:01.938745 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:35089
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:02.292266 6505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:02.292577 6505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:02.292675 6505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:02.300220 6505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:02.300338 6505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:02.300457 6505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:02.311080 6505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:35089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:02.312484 6505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:02.313829 6505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:02.328567 6511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:02.328501 6517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:02.328594 6513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:02.329655 6505 server_base.cc:1034] running on GCE node
I20260812 00:28:02.330338 6505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:02.331476 6505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:02.332774 6505 hybrid_clock.cc:648] HybridClock initialized: now 1786494482332714 us; error 52 us; skew 500 ppm
I20260812 00:28:02.333206 6505 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:02 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494482, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:02.337301 6505 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:28:02.339059 6505 webserver.cc:460] Webserver started at http://127.29.190.129:33153/ using document root <none> and password file <none>
I20260812 00:28:02.339980 6505 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:02.340159 6505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:02.340538 6505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:02.344146 6505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "608eae182be349528181f4547b917256"
format_stamp: "Formatted at 2026-08-12 00:28:02 on dist-test-slave-c12x"
server_key: "1474db3017e86156b03cb8815de22988"
server_key_iv: "96c2d76d4ac891d6d4467e24da4c407d"
server_key_version: "encryptionkey@0"
I20260812 00:28:02.345068 6505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "608eae182be349528181f4547b917256"
format_stamp: "Formatted at 2026-08-12 00:28:02 on dist-test-slave-c12x"
server_key: "1474db3017e86156b03cb8815de22988"
server_key_iv: "96c2d76d4ac891d6d4467e24da4c407d"
server_key_version: "encryptionkey@0"
I20260812 00:28:02.351315 6505 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:28:02.355252 6526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:02.356748 6505 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 00:28:02.356947 6505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "608eae182be349528181f4547b917256"
format_stamp: "Formatted at 2026-08-12 00:28:02 on dist-test-slave-c12x"
server_key: "1474db3017e86156b03cb8815de22988"
server_key_iv: "96c2d76d4ac891d6d4467e24da4c407d"
server_key_version: "encryptionkey@0"
I20260812 00:28:02.357205 6505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:02.395411 6505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:02.400235 6505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:02.400563 6505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:02.401684 6505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:02.403157 6505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:02.403234 6505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:02.403328 6505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:02.403373 6505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:02.438875 6505 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:46553
I20260812 00:28:02.438925 6713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:46553 every 8 connection(s)
I20260812 00:28:02.440325 6505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:02.445022 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 6505
I20260812 00:28:02.445243 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:28:02.446120 30458 external_mini_cluster.cc:1428] Setting key 3e5ef11a3dc24b7c9a1692ab77c803a2
Aug 12 00:28:02 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494482, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:02.464638 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:02.443091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51485 (local address 127.29.190.190:35089)
0812 00:28:02.443573 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:02.443578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:02.444619 (+ 1041us) server_negotiation.cc:407] Connection header received
0812 00:28:02.447365 (+ 2746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:02.447371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:02.447492 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:02.447618 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:02.449728 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:02.450504 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:02.453149 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:02.453580 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:02.453685 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:02.458233 (+ 4548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:02.458239 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:02.458242 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:02.458278 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:02.461210 (+ 2932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:02.462083 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:02.462090 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:02.462098 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:02.462267 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:02.462728 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:02.462733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:02.462736 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:02.463023 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:02.463184 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:02.464024 (+ 840us) server_negotiation.cc:299] Negotiation successful
0812 00:28:02.464263 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":212,"threads_started":1}
I20260812 00:28:02.465677 6718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:02.443662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:35089 (local address 127.29.190.129:51485)
0812 00:28:02.444384 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:02.444472 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:02.446986 (+ 2514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:02.447850 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:02.447859 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:02.448628 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:02.449514 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:02.449544 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:02.450699 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:02.450707 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:02.452960 (+ 2253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:02.452980 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:02.453832 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:02.453842 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:02.454201 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:02.455047 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:02.455098 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:02.457967 (+ 2869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:02.461368 (+ 3401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:02.461378 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:02.461397 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:02.461953 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:02.462386 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:02.462391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:02.462395 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:02.462600 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:02.463162 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:02.463170 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:02.463612 (+ 442us) client_negotiation.cc:769] Sending connection context
0812 00:28:02.463892 (+ 280us) client_negotiation.cc:240] Negotiation successful
0812 00:28:02.464470 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":299,"threads_started":1}
I20260812 00:28:02.467326 6714 heartbeater.cc:347] Connected to a master server at 127.29.190.190:35089
I20260812 00:28:02.467758 6714 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:02.468827 6714 heartbeater.cc:511] Master 127.29.190.190:35089 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
I20260812 00:28:02.471587 6408 ts_manager.cc:194] Registered new tserver with Master: 608eae182be349528181f4547b917256 (127.29.190.129:46553)
I20260812 00:28:02.473241 6408 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:51485
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:28:02.503147 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:35089
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:02.857957 6723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:02.858240 6723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:02.858335 6723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:02.865823 6723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:02.865940 6723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:02.866052 6723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:02.875908 6723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:35089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:02.877173 6723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:02.878463 6723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:02.891908 6735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:02.892145 6733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:02.892270 6732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:02.893316 6723 server_base.cc:1034] running on GCE node
I20260812 00:28:02.893954 6723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:02.894904 6723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:02.896113 6723 hybrid_clock.cc:648] HybridClock initialized: now 1786494482896073 us; error 28 us; skew 500 ppm
I20260812 00:28:02.896448 6723 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:02 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494482, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:02.899821 6723 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:28:02.901314 6723 webserver.cc:460] Webserver started at http://127.29.190.130:41987/ using document root <none> and password file <none>
I20260812 00:28:02.902014 6723 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:02.902117 6723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:02.902415 6723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:02.905611 6723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "03f103ad71bf47028dcf956c364f559e"
format_stamp: "Formatted at 2026-08-12 00:28:02 on dist-test-slave-c12x"
server_key: "2f42483a35751d82e4591b6018c12407"
server_key_iv: "e3f153ad853ee6ccedbc2c9fee71e375"
server_key_version: "encryptionkey@0"
I20260812 00:28:02.906394 6723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "03f103ad71bf47028dcf956c364f559e"
format_stamp: "Formatted at 2026-08-12 00:28:02 on dist-test-slave-c12x"
server_key: "2f42483a35751d82e4591b6018c12407"
server_key_iv: "e3f153ad853ee6ccedbc2c9fee71e375"
server_key_version: "encryptionkey@0"
I20260812 00:28:02.911741 6723 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:28:02.915269 6746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:02.916815 6723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:02.917001 6723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "03f103ad71bf47028dcf956c364f559e"
format_stamp: "Formatted at 2026-08-12 00:28:02 on dist-test-slave-c12x"
server_key: "2f42483a35751d82e4591b6018c12407"
server_key_iv: "e3f153ad853ee6ccedbc2c9fee71e375"
server_key_version: "encryptionkey@0"
I20260812 00:28:02.917268 6723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:02.945473 6723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:02.950187 6723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:02.950517 6723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:02.951589 6723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:02.952976 6723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:02.953083 6723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:02.953245 6723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:02.953325 6723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:02.989324 6723 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:43769
I20260812 00:28:02.989326 6916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:43769 every 8 connection(s)
I20260812 00:28:02.990680 6723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:02.999802 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 6723
I20260812 00:28:03.000002 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:28:03.000483 30458 external_mini_cluster.cc:1428] Setting key 056862101f5f37a8ce73314a32eb0e2d
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494482, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:03.013391 6921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:02.993339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:50463 (local address 127.29.190.190:35089)
0812 00:28:02.993850 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:02.993854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:02.994654 (+ 800us) server_negotiation.cc:407] Connection header received
0812 00:28:02.996637 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:02.996643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:02.996734 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:02.996857 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:02.998388 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:02.999133 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.000942 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.001575 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.001719 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.005651 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:03.005660 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:03.005667 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:03.005714 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:03.009612 (+ 3898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.010503 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.010512 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.010518 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.010694 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.011258 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.011265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.011270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.011703 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:03.011873 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:03.012941 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0812 00:28:03.013116 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":283,"threads_started":1}
I20260812 00:28:03.015194 6922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:02.993734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:35089 (local address 127.29.190.130:50463)
0812 00:28:02.994469 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:02.994521 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:02.996337 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:02.997112 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:02.997121 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:02.997624 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:02.998196 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:02.998226 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:02.999306 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:02.999310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:03.000788 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:03.000806 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.001815 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.001824 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:03.002073 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.002887 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:03.002918 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:03.005410 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:03.009786 (+ 4376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:03.009794 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:03.009809 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:03.010347 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:03.010846 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:03.010851 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:03.010854 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:03.011107 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:03.011868 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:03.011879 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:03.012451 (+ 572us) client_negotiation.cc:769] Sending connection context
0812 00:28:03.012835 (+ 384us) client_negotiation.cc:240] Negotiation successful
0812 00:28:03.013526 (+ 691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":308,"threads_started":1}
I20260812 00:28:03.016943 6919 heartbeater.cc:347] Connected to a master server at 127.29.190.190:35089
I20260812 00:28:03.017313 6919 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:03.018076 6919 heartbeater.cc:511] Master 127.29.190.190:35089 requested a full tablet report, sending...
I20260812 00:28:03.019719 6408 ts_manager.cc:194] Registered new tserver with Master: 03f103ad71bf47028dcf956c364f559e (127.29.190.130:43769)
I20260812 00:28:03.020699 6408 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:50463
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:28:03.061415 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:35089
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:35699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:03.412016 6925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:03.412346 6925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:03.412523 6925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:03.420063 6925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:03.420243 6925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:03.420434 6925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:03.430686 6925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:35699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:35089
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:03.432121 6925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:03.433503 6925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:03.448144 6932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:03.448167 6931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:03.448908 6934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:03.449013 6925 server_base.cc:1034] running on GCE node
I20260812 00:28:03.449792 6925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:03.450810 6925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:03.452071 6925 hybrid_clock.cc:648] HybridClock initialized: now 1786494483452045 us; error 53 us; skew 500 ppm
I20260812 00:28:03.452430 6925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:03.455981 6925 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:28:03.457723 6925 webserver.cc:460] Webserver started at http://127.29.190.131:46513/ using document root <none> and password file <none>
I20260812 00:28:03.458495 6925 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:03.458664 6925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:03.459012 6925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:03.462379 6925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "5d74e0d962354f81bffaa21d4bd2d39a"
format_stamp: "Formatted at 2026-08-12 00:28:03 on dist-test-slave-c12x"
server_key: "e6f55d178457e9ca14a71b98ee290de8"
server_key_iv: "6bf20526d9240ca549b25c69c4d883a2"
server_key_version: "encryptionkey@0"
I20260812 00:28:03.463243 6925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "5d74e0d962354f81bffaa21d4bd2d39a"
format_stamp: "Formatted at 2026-08-12 00:28:03 on dist-test-slave-c12x"
server_key: "e6f55d178457e9ca14a71b98ee290de8"
server_key_iv: "6bf20526d9240ca549b25c69c4d883a2"
server_key_version: "encryptionkey@0"
I20260812 00:28:03.469069 6925 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 00:28:03.473013 6944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:03.474576 6925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:28:03.474808 6925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "5d74e0d962354f81bffaa21d4bd2d39a"
format_stamp: "Formatted at 2026-08-12 00:28:03 on dist-test-slave-c12x"
server_key: "e6f55d178457e9ca14a71b98ee290de8"
server_key_iv: "6bf20526d9240ca549b25c69c4d883a2"
server_key_version: "encryptionkey@0"
I20260812 00:28:03.475050 6925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:03.476693 6714 heartbeater.cc:503] Master 127.29.190.190:35089 was elected leader, sending a full tablet report...
I20260812 00:28:03.502769 6925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:03.508059 6925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:03.508371 6925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:03.509444 6925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:03.510977 6925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:03.511060 6925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:03.511157 6925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:03.511210 6925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:03.547781 6925 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:41803
I20260812 00:28:03.547780 7116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:41803 every 8 connection(s)
I20260812 00:28:03.549198 6925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:03.558292 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 6925
I20260812 00:28:03.558480 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:28:03.558970 30458 external_mini_cluster.cc:1428] Setting key ccdf773dae7dc3e03e8d31b2c40327c2
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:03.571394 7120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:03.552059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:60215 (local address 127.29.190.190:35089)
0812 00:28:03.552541 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.552545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.553387 (+ 842us) server_negotiation.cc:407] Connection header received
0812 00:28:03.555510 (+ 2123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.555517 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.555635 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.555767 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.557437 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.558525 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.560656 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.561235 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.561363 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.565279 (+ 3916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:03.565289 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:03.565293 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:03.565328 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:03.568099 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.568877 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.568884 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.568887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.569024 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.569502 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.569507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.569510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.569791 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:03.569969 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:03.570723 (+ 754us) server_negotiation.cc:299] Negotiation successful
0812 00:28:03.570959 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":263,"threads_started":1}
I20260812 00:28:03.572446 7121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:03.552467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:35089 (local address 127.29.190.131:60215)
0812 00:28:03.553211 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:03.553257 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:03.555151 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:03.556025 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:03.556034 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:03.556637 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:03.557243 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:03.557262 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.558705 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.558710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:03.560496 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:03.560511 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.561474 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.561483 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:03.561749 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.562532 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:03.562600 (+ 68us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:03.565034 (+ 2434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:03.568253 (+ 3219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:03.568263 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:03.568283 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:03.568747 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:03.569167 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:03.569172 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:03.569175 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:03.569377 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:03.569954 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:03.569962 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:03.570326 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 00:28:03.570627 (+ 301us) client_negotiation.cc:240] Negotiation successful
0812 00:28:03.571212 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":301,"threads_started":1}
I20260812 00:28:03.574404 7117 heartbeater.cc:347] Connected to a master server at 127.29.190.190:35089
I20260812 00:28:03.574795 7117 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:03.575803 7117 heartbeater.cc:511] Master 127.29.190.190:35089 requested a full tablet report, sending...
I20260812 00:28:03.577389 6408 ts_manager.cc:194] Registered new tserver with Master: 5d74e0d962354f81bffaa21d4bd2d39a (127.29.190.131:41803)
I20260812 00:28:03.578233 6408 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:60215
I20260812 00:28:03.589570 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/test-admin.keytab.
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:03.622685 30458 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 00:28:03.630337 7129 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:03.626168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48190 (local address 127.29.190.129:46553)
0812 00:28:03.626909 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.626921 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.627760 (+ 839us) server_negotiation.cc:407] Connection header received
0812 00:28:03.628036 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.628048 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.628322 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.628521 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.629777 (+ 1256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48190: BlockingRecv error: recv got EOF from 127.0.0.1:48190 (error 108)
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":361,"threads_started":1}
W20260812 00:28:03.630352 30458 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:03.632261 30458 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:03.633698 30458 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:28:03.652710 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:03.635812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.29.190.129:46553)
0812 00:28:03.636047 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.636055 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.636202 (+ 147us) server_negotiation.cc:407] Connection header received
0812 00:28:03.636460 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.636467 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.636548 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.636676 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.637871 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.638987 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.640508 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.641236 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.641404 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.645857 (+ 4453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:03.645872 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:03.645889 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:03.645933 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:03.649374 (+ 3441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.650226 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.650235 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.650237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.650395 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.650845 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.650850 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.650852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.651286 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:03.651680 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:03.652064 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 00:28:03.652383 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260812 00:28:03.659559 7129 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:03.657665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48204 (local address 127.29.190.129:46553)
0812 00:28:03.657944 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.657949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.658095 (+ 146us) server_negotiation.cc:407] Connection header received
0812 00:28:03.658235 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.658239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.658302 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.658384 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.659229 (+ 845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48204: BlockingRecv error: recv got EOF from 127.0.0.1:48204 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260812 00:28:03.659658 30458 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:03.661459 30458 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:03.663341 30458 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:28:03.680874 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:03.665150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48214 (local address 127.29.190.129:46553)
0812 00:28:03.665405 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.665414 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.665860 (+ 446us) server_negotiation.cc:407] Connection header received
0812 00:28:03.666077 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.666083 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.666160 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.666270 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.667519 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.668305 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.669727 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.670260 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.670415 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.674844 (+ 4429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:03.674851 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:03.674854 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:03.674922 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:03.677869 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.678682 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.678687 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.678690 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.678861 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.679289 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.679294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.679298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.679707 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:03.680007 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:03.680333 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 00:28:03.680558 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 00:28:03.686017 7129 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:03.683964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48224 (local address 127.29.190.129:46553)
0812 00:28:03.684178 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.684184 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.684345 (+ 161us) server_negotiation.cc:407] Connection header received
0812 00:28:03.684604 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.684609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.684692 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.684797 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.685764 (+ 967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48224: BlockingRecv error: recv got EOF from 127.0.0.1:48224 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260812 00:28:03.686172 30458 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786494426716583-30458-0/krb5kdc/krb5cc' of type FILE
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:03.688242 30458 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:03.689769 30458 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:28:03.706637 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:03.691972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48240 (local address 127.29.190.129:46553)
0812 00:28:03.692221 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.692229 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.692556 (+ 327us) server_negotiation.cc:407] Connection header received
0812 00:28:03.692798 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.692803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.692866 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.692976 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.693965 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.694722 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.696078 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.696524 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.696664 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.700684 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:03.700689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:03.700693 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:03.700731 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:03.703693 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.704381 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.704386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.704388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.704588 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.704955 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.704958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.704960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.705283 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:03.705534 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:03.705995 (+ 461us) server_negotiation.cc:299] Negotiation successful
0812 00:28:03.706292 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:28:03.708374 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 6505
I20260812 00:28:03.721700 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:03.709177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48252 (local address 127.29.190.129:46553)
0812 00:28:03.709376 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.709381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.709798 (+ 417us) server_negotiation.cc:407] Connection header received
0812 00:28:03.709945 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.709949 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.710014 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.710104 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.711031 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.711837 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.713111 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.713534 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.713627 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.715873 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:03.715879 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:03.715882 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:03.715913 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:03.718643 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.719290 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.719295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.719297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.719542 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.719977 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.719981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.719984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.720337 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:03.720662 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:03.721036 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 00:28:03.721293 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:28:03.722681 6706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:03.820685 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 6505
I20260812 00:28:03.848109 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 6723
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:28:03.865820 7146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:03.849222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44304 (local address 127.29.190.130:43769)
0812 00:28:03.849816 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.849824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.849851 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:28:03.849915 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.849922 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.850143 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.850272 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.851277 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.852426 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.853947 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.854588 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.854706 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.859144 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:03.859159 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:03.859177 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:03.859219 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:03.862407 (+ 3188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.863225 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.863234 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.863237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.863643 (+ 406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.864141 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.864145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.864148 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.864597 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:03.864864 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:03.865269 (+ 405us) server_negotiation.cc:299] Negotiation successful
0812 00:28:03.865495 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":295,"threads_started":1}
I20260812 00:28:03.867242 6910 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:03.953145 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 6723
I20260812 00:28:03.977705 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 6925
Aug 12 00:28:03 dist-test-slave-c12x krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:28:03.996183 7148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:03.978772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33826 (local address 127.29.190.131:41803)
0812 00:28:03.979336 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:03.979343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:03.979377 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:28:03.979526 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:03.979542 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:03.979786 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:03.979972 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:03.981430 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.982481 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.983979 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:03.984568 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:03.984727 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:03.989556 (+ 4829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:03.989571 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:03.989587 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:03.989634 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:03.992923 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.993686 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.993694 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.993696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.993845 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:03.994307 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:03.994312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:03.994314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:03.994780 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:03.995044 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:03.995415 (+ 371us) server_negotiation.cc:299] Negotiation successful
0812 00:28:03.995818 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":258,"threads_started":1}
I20260812 00:28:03.997663 7110 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:04.082937 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 6925
I20260812 00:28:04.111793 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 6360
I20260812 00:28:04.113121 6454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:04.219623 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 6360
2026-08-12T00:28:04Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4552 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:28:04 dist-test-slave-c12x krb5kdc[7156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:28:04 dist-test-slave-c12x krb5kdc[7156](info): set up 2 sockets
Aug 12 00:28:04 dist-test-slave-c12x krb5kdc[7156](info): commencing operation
krb5kdc: starting...
W20260812 00:28:05.588845 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:28:05 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:28:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:05Z Disabled control of system clock
WARNING: no policy specified for oryx/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.190.keytab.
Entry for principal oryx/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.190.keytab.
I20260812 00:28:05.868722 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36827
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.190.keytab
--principal=oryx/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:36827
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:06.233541 7173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:06.233877 7173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:06.234056 7173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:06.241707 7173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:06.241853 7173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:06.241954 7173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:06.242057 7173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:06.242125 7173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:06.252928 7173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:36827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.190.keytab
--principal=oryx/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:06.254472 7173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:06.255921 7173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:06.269529 7183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:06.269467 7187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:06.269506 7182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:06.273329 7173 server_base.cc:1034] running on GCE node
I20260812 00:28:06.274392 7173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:06.276216 7173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:06.277515 7173 hybrid_clock.cc:648] HybridClock initialized: now 1786494486277458 us; error 45 us; skew 500 ppm
I20260812 00:28:06.277932 7173 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:06 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494486, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:06.281659 7173 init.cc:377] Logged in from keytab as oryx/127.29.190.190@KRBTEST.COM (short username oryx)
I20260812 00:28:06.283799 7173 webserver.cc:460] Webserver started at http://127.29.190.190:38393/ using document root <none> and password file <none>
I20260812 00:28:06.284626 7173 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:06.284791 7173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:06.285144 7173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:06.288542 7173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "909aa1c69f91424a848cd6df1ac9b4a8"
format_stamp: "Formatted at 2026-08-12 00:28:06 on dist-test-slave-c12x"
server_key: "7da5b2116f63a656142e1f43d12d9366"
server_key_iv: "cbd181c18970a02f8d5af34d17ca2242"
server_key_version: "encryptionkey@0"
I20260812 00:28:06.289423 7173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "909aa1c69f91424a848cd6df1ac9b4a8"
format_stamp: "Formatted at 2026-08-12 00:28:06 on dist-test-slave-c12x"
server_key: "7da5b2116f63a656142e1f43d12d9366"
server_key_iv: "cbd181c18970a02f8d5af34d17ca2242"
server_key_version: "encryptionkey@0"
I20260812 00:28:06.295692 7173 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:28:06.299861 7203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:06.301456 7173 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:28:06.301718 7173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "909aa1c69f91424a848cd6df1ac9b4a8"
format_stamp: "Formatted at 2026-08-12 00:28:06 on dist-test-slave-c12x"
server_key: "7da5b2116f63a656142e1f43d12d9366"
server_key_iv: "cbd181c18970a02f8d5af34d17ca2242"
server_key_version: "encryptionkey@0"
I20260812 00:28:06.301962 7173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:06.316268 7173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:06.321771 7173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:06.322150 7173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:06.344859 7173 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:36827
I20260812 00:28:06.344909 7281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:36827 every 8 connection(s)
I20260812 00:28:06.346503 7173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:28:06.348594 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 7173
I20260812 00:28:06.348825 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:28:06.349730 30458 external_mini_cluster.cc:1428] Setting key 578f983b45498c7c3e043569fb07b94c
I20260812 00:28:06.351914 7283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:06.365407 7283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: Bootstrap starting.
Aug 12 00:28:06 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:06.370184 7283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:06.371630 7283 log.cc:824] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:06.375303 7283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: No bootstrap required, opened a new log
I20260812 00:28:06.377115 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:06.352142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48962 (local address 127.29.190.190:36827)
0812 00:28:06.353007 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:06.353024 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:06.353067 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:28:06.354958 (+ 1891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:06.354984 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:06.355413 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:06.355992 (+ 579us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:06.357676 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:06.359073 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:06.360534 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:06.361406 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:06.361699 (+ 293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:06.367840 (+ 6141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:06.367850 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:06.367867 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:06.367917 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:06.372431 (+ 4514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:06.373303 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:06.373311 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:06.373318 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:06.373502 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:06.373950 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:06.373960 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:06.373962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:06.374533 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:06.374909 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:06.375362 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 00:28:06.375859 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":374,"threads_started":1}
I20260812 00:28:06.384943 7283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } }
I20260812 00:28:06.385679 7283 raft_consensus.cc:374] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:06.385839 7283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 909aa1c69f91424a848cd6df1ac9b4a8, State: Initialized, Role: FOLLOWER
I20260812 00:28:06.386520 7283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } }
I20260812 00:28:06.386806 7283 raft_consensus.cc:388] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:28:06.386970 7283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:28:06.387179 7283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:06.389905 7283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } }
I20260812 00:28:06.390549 7283 leader_election.cc:302] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 909aa1c69f91424a848cd6df1ac9b4a8; no voters:
I20260812 00:28:06.391284 7283 leader_election.cc:288] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:28:06.391486 7288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:06.392875 7288 raft_consensus.cc:686] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 1 LEADER]: Becoming Leader. State: Replica: 909aa1c69f91424a848cd6df1ac9b4a8, State: Running, Role: LEADER
I20260812 00:28:06.393456 7288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } }
I20260812 00:28:06.393788 7283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:06.396649 7290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 909aa1c69f91424a848cd6df1ac9b4a8. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } }
I20260812 00:28:06.397037 7290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:06.396754 7289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } }
I20260812 00:28:06.397209 7289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:06.409729 7300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:06.415560 7300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:06.425575 7300 catalog_manager.cc:1347] Generated new cluster ID: aa623a1f0b844db4bba89df78bfa3a50
I20260812 00:28:06.425714 7300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:06.453984 7300 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:28:06.455677 7300 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:06.464576 7300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: Generated new TSK 0
I20260812 00:28:06.465528 7300 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab.
Entry for principal oryx/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab.
I20260812 00:28:06.547132 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36827
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab
--principal=oryx/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:06.947165 7317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:06.947574 7317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:06.947751 7317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:06.955531 7317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:06.955729 7317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:06.955920 7317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:06.966578 7317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab
--principal=oryx/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:06.968232 7317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:06.969743 7317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:06.986200 7328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:06.986353 7324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:06.986443 7323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:06.988777 7317 server_base.cc:1034] running on GCE node
I20260812 00:28:06.989697 7317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:06.990886 7317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:06.992112 7317 hybrid_clock.cc:648] HybridClock initialized: now 1786494486992047 us; error 54 us; skew 500 ppm
I20260812 00:28:06.992493 7317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:06 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494486, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:07.001386 7317 init.cc:377] Logged in from keytab as oryx/127.29.190.129@KRBTEST.COM (short username oryx)
I20260812 00:28:07.003542 7317 webserver.cc:460] Webserver started at http://127.29.190.129:42375/ using document root <none> and password file <none>
I20260812 00:28:07.004448 7317 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:07.004638 7317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:07.005038 7317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:07.009394 7317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "1715ce364f664f9eb906915c20b88dee"
format_stamp: "Formatted at 2026-08-12 00:28:07 on dist-test-slave-c12x"
server_key: "1608ea4d0b986e19900417bed64a056e"
server_key_iv: "3490fe82a5774229880bb9865c144d8b"
server_key_version: "encryptionkey@0"
I20260812 00:28:07.010637 7317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "1715ce364f664f9eb906915c20b88dee"
format_stamp: "Formatted at 2026-08-12 00:28:07 on dist-test-slave-c12x"
server_key: "1608ea4d0b986e19900417bed64a056e"
server_key_iv: "3490fe82a5774229880bb9865c144d8b"
server_key_version: "encryptionkey@0"
I20260812 00:28:07.017045 7317 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260812 00:28:07.021509 7337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:07.024086 7317 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:28:07.024353 7317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "1715ce364f664f9eb906915c20b88dee"
format_stamp: "Formatted at 2026-08-12 00:28:07 on dist-test-slave-c12x"
server_key: "1608ea4d0b986e19900417bed64a056e"
server_key_iv: "3490fe82a5774229880bb9865c144d8b"
server_key_version: "encryptionkey@0"
I20260812 00:28:07.024662 7317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:07.048025 7317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:07.053859 7317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:07.054281 7317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:07.055529 7317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:07.057184 7317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:07.057305 7317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:07.057471 7317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:07.057554 7317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:07.096393 7317 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:34785
I20260812 00:28:07.096434 7523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:34785 every 8 connection(s)
I20260812 00:28:07.097826 7317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:07.100314 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 7317
I20260812 00:28:07.100558 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:28:07.101481 30458 external_mini_cluster.cc:1428] Setting key 3c22c06721b24433ba2e3d94fc602f44
Aug 12 00:28:07 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494486, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:07.124487 7526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:07.101016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51203 (local address 127.29.190.190:36827)
0812 00:28:07.101572 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:07.101579 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:07.102693 (+ 1114us) server_negotiation.cc:407] Connection header received
0812 00:28:07.104767 (+ 2074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:07.104776 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:07.104877 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:07.105015 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:07.106784 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:07.108055 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:07.109789 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:07.110682 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:07.110845 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:07.116518 (+ 5673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:07.116525 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:07.116528 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:07.116571 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:07.119776 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:07.121158 (+ 1382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:07.121163 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:07.121166 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:07.121349 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:07.122121 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:07.122127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:07.122129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:07.122540 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:07.122688 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:07.123988 (+ 1300us) server_negotiation.cc:299] Negotiation successful
0812 00:28:07.124202 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":276,"threads_started":1}
I20260812 00:28:07.126381 7527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:07.101602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.129:51203)
0812 00:28:07.102516 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:07.102579 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:07.104447 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:07.105266 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:07.105275 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:07.105917 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:07.106542 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:07.106567 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:07.108232 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:07.108236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:07.109586 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:07.109600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:07.110994 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:07.111000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:07.111250 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:07.112303 (+ 1053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:07.112336 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:07.116158 (+ 3822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:07.119999 (+ 3841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:07.120015 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:07.120041 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:07.120958 (+ 917us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:07.121611 (+ 653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:07.121620 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:07.121627 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:07.121945 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:07.122723 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:07.122736 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:07.123342 (+ 606us) client_negotiation.cc:769] Sending connection context
0812 00:28:07.123798 (+ 456us) client_negotiation.cc:240] Negotiation successful
0812 00:28:07.124561 (+ 763us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":381,"threads_started":1}
I20260812 00:28:07.128538 7524 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36827
I20260812 00:28:07.128955 7524 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:07.130038 7524 heartbeater.cc:511] Master 127.29.190.190:36827 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.29.190.130@KRBTEST.COM; defaulting to no policy
I20260812 00:28:07.133080 7225 ts_manager.cc:194] Registered new tserver with Master: 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.130@KRBTEST.COM" created.
I20260812 00:28:07.135418 7225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:51203
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab.
Entry for principal oryx/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab.
I20260812 00:28:07.168857 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36827
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab
--principal=oryx/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:07.535728 7532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:07.536062 7532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:07.536237 7532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:07.544267 7532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:07.544435 7532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:07.544649 7532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:07.555807 7532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab
--principal=oryx/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:07.557332 7532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:07.559108 7532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:07.575546 7539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:07.575634 7537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:07.575519 7542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:07.582398 7532 server_base.cc:1034] running on GCE node
I20260812 00:28:07.583307 7532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:07.584585 7532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:07.585898 7532 hybrid_clock.cc:648] HybridClock initialized: now 1786494487585861 us; error 65 us; skew 500 ppm
I20260812 00:28:07.586323 7532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:07 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494487, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:07.590564 7532 init.cc:377] Logged in from keytab as oryx/127.29.190.130@KRBTEST.COM (short username oryx)
I20260812 00:28:07.592602 7532 webserver.cc:460] Webserver started at http://127.29.190.130:34317/ using document root <none> and password file <none>
I20260812 00:28:07.593532 7532 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:07.593725 7532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:07.594123 7532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:07.598064 7532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "9a4dc642e03b4bcca9b167edaad716e8"
format_stamp: "Formatted at 2026-08-12 00:28:07 on dist-test-slave-c12x"
server_key: "b16667b872cf83c22dd3c68a5b8c00c3"
server_key_iv: "9b034e353275b079dbb7678fb75457ae"
server_key_version: "encryptionkey@0"
I20260812 00:28:07.599105 7532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "9a4dc642e03b4bcca9b167edaad716e8"
format_stamp: "Formatted at 2026-08-12 00:28:07 on dist-test-slave-c12x"
server_key: "b16667b872cf83c22dd3c68a5b8c00c3"
server_key_iv: "9b034e353275b079dbb7678fb75457ae"
server_key_version: "encryptionkey@0"
I20260812 00:28:07.607337 7532 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.001s
I20260812 00:28:07.612042 7552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:07.613675 7532 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:28:07.613920 7532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "9a4dc642e03b4bcca9b167edaad716e8"
format_stamp: "Formatted at 2026-08-12 00:28:07 on dist-test-slave-c12x"
server_key: "b16667b872cf83c22dd3c68a5b8c00c3"
server_key_iv: "9b034e353275b079dbb7678fb75457ae"
server_key_version: "encryptionkey@0"
I20260812 00:28:07.614197 7532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:07.631302 7532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:07.636308 7532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:07.636657 7532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:07.637801 7532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:07.639329 7532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:07.639446 7532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:07.639631 7532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:07.639711 7532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:07.676896 7532 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:44105
I20260812 00:28:07.676934 7717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:44105 every 8 connection(s)
I20260812 00:28:07.678355 7532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:07.688405 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 7532
I20260812 00:28:07.688629 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:28:07.689193 30458 external_mini_cluster.cc:1428] Setting key 9b4c4d9258e5a9e807f9eca071a62ae9
Aug 12 00:28:07 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494487, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:07.704192 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:07.681402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:55009 (local address 127.29.190.190:36827)
0812 00:28:07.681986 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:07.681994 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:07.683199 (+ 1205us) server_negotiation.cc:407] Connection header received
0812 00:28:07.685865 (+ 2666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:07.685873 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:07.685989 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:07.686151 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:07.688227 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:07.689141 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:07.691701 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:07.692169 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:07.692270 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:07.697741 (+ 5471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:07.697747 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:07.697750 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:07.697789 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:07.700623 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:07.701525 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:07.701530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:07.701532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:07.701670 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:07.702184 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:07.702194 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:07.702196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:07.702497 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:07.702681 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:07.703542 (+ 861us) server_negotiation.cc:299] Negotiation successful
0812 00:28:07.703801 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":300,"threads_started":1}
I20260812 00:28:07.705255 7721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:07.681976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.130:55009)
0812 00:28:07.682983 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:07.683035 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:07.685413 (+ 2378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:07.686551 (+ 1138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:07.686569 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:07.687174 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:07.687992 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:07.688026 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:07.689364 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:07.689374 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:07.691370 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:07.691402 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:07.692491 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:07.692502 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:07.692904 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:07.693792 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:07.693833 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:07.697414 (+ 3581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:07.700815 (+ 3401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:07.700827 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:07.700849 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:07.701358 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:07.701802 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:07.701808 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:07.701811 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:07.702035 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:07.702666 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:07.702675 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:07.703088 (+ 413us) client_negotiation.cc:769] Sending connection context
0812 00:28:07.703384 (+ 296us) client_negotiation.cc:240] Negotiation successful
0812 00:28:07.704016 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":438,"threads_started":1}
I20260812 00:28:07.707147 7718 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36827
I20260812 00:28:07.707651 7718 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:07.708673 7718 heartbeater.cc:511] Master 127.29.190.190:36827 requested a full tablet report, sending...
I20260812 00:28:07.710516 7225 ts_manager.cc:194] Registered new tserver with Master: 9a4dc642e03b4bcca9b167edaad716e8 (127.29.190.130:44105)
I20260812 00:28:07.711419 7225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:55009
WARNING: no policy specified for oryx/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab.
Entry for principal oryx/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab.
I20260812 00:28:07.756855 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36827
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab
--principal=oryx/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:08.134894 7724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:08.135245 7724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:08.135357 7724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 00:28:08.139545 7524 heartbeater.cc:503] Master 127.29.190.190:36827 was elected leader, sending a full tablet report...
W20260812 00:28:08.144325 7724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:08.144456 7724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:08.144655 7724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:08.156217 7724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab
--principal=oryx/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:08.157697 7724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:08.159256 7724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:08.175119 7733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:08.175192 7731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:08.175220 7735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:08.175752 7724 server_base.cc:1034] running on GCE node
I20260812 00:28:08.176628 7724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:08.177771 7724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:08.179024 7724 hybrid_clock.cc:648] HybridClock initialized: now 1786494488178945 us; error 62 us; skew 500 ppm
I20260812 00:28:08.179409 7724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:08 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494488, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:08.183280 7724 init.cc:377] Logged in from keytab as oryx/127.29.190.131@KRBTEST.COM (short username oryx)
I20260812 00:28:08.184950 7724 webserver.cc:460] Webserver started at http://127.29.190.131:44375/ using document root <none> and password file <none>
I20260812 00:28:08.185735 7724 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:08.185901 7724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:08.186239 7724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:08.189545 7724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "d29d7ac26b514f978d5fc8994b44da30"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "f204c830c2589070d1e054b8f9fcc6de"
server_key_iv: "6cd129b1268c2eb4e626f673bd60f66c"
server_key_version: "encryptionkey@0"
I20260812 00:28:08.190390 7724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "d29d7ac26b514f978d5fc8994b44da30"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "f204c830c2589070d1e054b8f9fcc6de"
server_key_iv: "6cd129b1268c2eb4e626f673bd60f66c"
server_key_version: "encryptionkey@0"
I20260812 00:28:08.196408 7724 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:28:08.200554 7749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:08.202087 7724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260812 00:28:08.202310 7724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "d29d7ac26b514f978d5fc8994b44da30"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "f204c830c2589070d1e054b8f9fcc6de"
server_key_iv: "6cd129b1268c2eb4e626f673bd60f66c"
server_key_version: "encryptionkey@0"
I20260812 00:28:08.202566 7724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:08.235105 7724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:08.240123 7724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:08.240481 7724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:08.241634 7724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:08.243144 7724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:08.243268 7724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:08.243454 7724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:08.243561 7724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260812 00:28:08.280974 7724 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:42863
I20260812 00:28:08.281031 7916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:42863 every 8 connection(s)
I20260812 00:28:08.282330 7724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:08.287707 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 7724
I20260812 00:28:08.287914 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:28:08.288420 30458 external_mini_cluster.cc:1428] Setting key d82ee21ae872ba5afbca7e92d3d6ecf4
Aug 12 00:28:08 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494488, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:08.304862 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.285190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:48269 (local address 127.29.190.190:36827)
0812 00:28:08.285719 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:08.285723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:08.286746 (+ 1023us) server_negotiation.cc:407] Connection header received
0812 00:28:08.289447 (+ 2701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:08.289452 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:08.289525 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:08.289669 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:08.291495 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.292402 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.294158 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.294603 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.294752 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.298660 (+ 3908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:08.298665 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:08.298669 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:08.298705 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:08.301401 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.302196 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.302201 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.302203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.302343 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.302892 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.302898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.302901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.303247 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:08.303432 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:08.304209 (+ 777us) server_negotiation.cc:299] Negotiation successful
0812 00:28:08.304449 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":285,"threads_started":1}
I20260812 00:28:08.306025 7920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.285791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.131:48269)
0812 00:28:08.286566 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:08.286606 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:08.288897 (+ 2291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:08.289969 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:08.289984 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:08.290677 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:08.291281 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.291300 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.292593 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.292596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.293997 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.294011 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.294873 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.294881 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.295205 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.296033 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:08.296059 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:08.298402 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:08.301569 (+ 3167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.301577 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.301592 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.302033 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.302501 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.302507 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.302512 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.302748 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.303396 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:08.303405 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:08.303817 (+ 412us) client_negotiation.cc:769] Sending connection context
0812 00:28:08.304112 (+ 295us) client_negotiation.cc:240] Negotiation successful
0812 00:28:08.304686 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":329,"threads_started":1}
I20260812 00:28:08.307741 7917 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36827
I20260812 00:28:08.308039 7917 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:08.308736 7917 heartbeater.cc:511] Master 127.29.190.190:36827 requested a full tablet report, sending...
I20260812 00:28:08.310155 7225 ts_manager.cc:194] Registered new tserver with Master: d29d7ac26b514f978d5fc8994b44da30 (127.29.190.131:42863)
I20260812 00:28:08.310940 7225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:48269
I20260812 00:28:08.317521 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.29.190.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.189.keytab.
Entry for principal oryx/127.29.190.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.189.keytab.
I20260812 00:28:08.376317 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.189:35947
--webserver_interface=127.29.190.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.189.keytab
--principal=oryx/127.29.190.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:36827,127.29.190.189:35947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:28:08.714674 7718 heartbeater.cc:503] Master 127.29.190.190:36827 was elected leader, sending a full tablet report...
W20260812 00:28:08.740593 7924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:08.741072 7924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:08.741266 7924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:08.749197 7924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:08.749421 7924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:08.749549 7924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:08.749645 7924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:08.749713 7924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:08.760372 7924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:36827,127.29.190.189:35947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.189.keytab
--principal=oryx/127.29.190.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.189:35947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.190.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
W20260812 00:28:08.760866 7924 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.29.190.190:36827,127.29.190.189:35947'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 00:28:08.762106 7924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:08.763513 7924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:08.776847 7930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:08.776872 7935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:08.776947 7933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:08.777740 7924 server_base.cc:1034] running on GCE node
I20260812 00:28:08.778647 7924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:08.780349 7924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:08.781658 7924 hybrid_clock.cc:648] HybridClock initialized: now 1786494488781586 us; error 33 us; skew 500 ppm
I20260812 00:28:08.782070 7924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:08 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494488, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:08.786046 7924 init.cc:377] Logged in from keytab as oryx/127.29.190.189@KRBTEST.COM (short username oryx)
I20260812 00:28:08.787971 7924 webserver.cc:460] Webserver started at http://127.29.190.189:42101/ using document root <none> and password file <none>
I20260812 00:28:08.788870 7924 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:08.789047 7924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:08.789477 7924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:08.792997 7924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data/instance:
uuid: "3bb743aa935747e0b95dc4cd20207112"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "5ff03b774497d9366d9a3421b54d7042"
server_key_iv: "ee23fdf0824662e6079fe3408f64dc2d"
server_key_version: "encryptionkey@0"
I20260812 00:28:08.793952 7924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal/instance:
uuid: "3bb743aa935747e0b95dc4cd20207112"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "5ff03b774497d9366d9a3421b54d7042"
server_key_iv: "ee23fdf0824662e6079fe3408f64dc2d"
server_key_version: "encryptionkey@0"
I20260812 00:28:08.800103 7924 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:28:08.804164 7948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:08.806092 7924 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:28:08.806319 7924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
uuid: "3bb743aa935747e0b95dc4cd20207112"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "5ff03b774497d9366d9a3421b54d7042"
server_key_iv: "ee23fdf0824662e6079fe3408f64dc2d"
server_key_version: "encryptionkey@0"
I20260812 00:28:08.806648 7924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:08.832185 7924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:08.837169 7924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:08.837512 7924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:08.857573 7924 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.189:35947
I20260812 00:28:08.857599 8020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.189:35947 every 8 connection(s)
I20260812 00:28:08.859107 7924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
I20260812 00:28:08.863142 8021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:08.863801 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 7924
I20260812 00:28:08.873538 8021 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:28:08 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.189@KRBTEST.COM
Aug 12 00:28:08 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494488, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.189@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:08.891073 8026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.866353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60870 (local address 127.29.190.189:35947)
0812 00:28:08.867535 (+ 1182us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:08.867557 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:08.867605 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:28:08.869855 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:08.869884 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:08.870358 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:08.870752 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:08.872818 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.874247 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.876187 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.877311 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.877515 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.882508 (+ 4993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:08.882516 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:08.882535 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:08.882577 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:08.885875 (+ 3298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.886765 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.886774 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.886783 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.886967 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.887653 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.887658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.887660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.888465 (+ 805us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:08.888727 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:08.889381 (+ 654us) server_negotiation.cc:299] Negotiation successful
0812 00:28:08.889888 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":858,"thread_start_us":554,"threads_started":1}
I20260812 00:28:08.895399 8029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.876503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:48974)
0812 00:28:08.877530 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:08.877572 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:08.877743 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:08.878287 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:08.878292 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:08.879267 (+ 975us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:08.879685 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.879702 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.880821 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.880828 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.882352 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.882370 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.883525 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.883531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.883677 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.884363 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:08.884398 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:08.887030 (+ 2632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:08.891111 (+ 4081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.891123 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.891131 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.892741 (+ 1610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.893296 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.893300 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.893302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.893447 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.894304 (+ 857us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:08.894314 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:08.894526 (+ 212us) client_negotiation.cc:769] Sending connection context
0812 00:28:08.894739 (+ 213us) client_negotiation.cc:240] Negotiation successful
0812 00:28:08.895114 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":562,"threads_started":1}
I20260812 00:28:08.895547 8027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.876537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48974 (local address 127.29.190.190:36827)
0812 00:28:08.877166 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:08.877172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:08.877847 (+ 675us) server_negotiation.cc:407] Connection header received
0812 00:28:08.877905 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:08.877909 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:08.878046 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:08.878164 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:08.879873 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.880662 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.882573 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.882990 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.883158 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.887284 (+ 4126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:08.887292 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:08.887296 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:08.887349 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:08.890938 (+ 3589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.892929 (+ 1991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.892936 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.892939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.893161 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.893629 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.893635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.893638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.894109 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:08.894276 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:08.894897 (+ 621us) server_negotiation.cc:299] Negotiation successful
0812 00:28:08.895176 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":297,"threads_started":1}
I20260812 00:28:08.897294 8021 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:28:08 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494488, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.189@KRBTEST.COM for oryx/127.29.190.189@KRBTEST.COM
I20260812 00:28:08.912425 8029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.898117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.0.0.1:60880)
0812 00:28:08.898328 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:08.898348 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:08.898452 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:08.898778 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:08.898781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:08.899093 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:08.899228 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.899235 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.900250 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.900254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.901163 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.901174 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.902122 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.902126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.902254 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.902966 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:08.902983 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:08.905398 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:08.909258 (+ 3860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.909263 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.909266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.909786 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.910255 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.910260 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.910264 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.910475 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.911234 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:08.911239 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:08.911568 (+ 329us) client_negotiation.cc:769] Sending connection context
0812 00:28:08.911780 (+ 212us) client_negotiation.cc:240] Negotiation successful
0812 00:28:08.912115 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 00:28:08.912533 8026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.898390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60880 (local address 127.29.190.189:35947)
0812 00:28:08.898534 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:08.898538 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:08.898554 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:28:08.898598 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:08.898601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:08.898653 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:08.898734 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:08.899347 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.900119 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.901346 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.901918 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.902041 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.905861 (+ 3820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:08.905866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:08.905869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:08.905914 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:08.909048 (+ 3134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.909940 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.909944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.909947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.910072 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.910706 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.910714 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.910720 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.911084 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:08.911211 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:08.911895 (+ 684us) server_negotiation.cc:299] Negotiation successful
0812 00:28:08.912259 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":163,"server-negotiator.queue_time_us":54}
I20260812 00:28:08.917810 8021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Bootstrap starting.
I20260812 00:28:08.921217 8021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:08.922487 8021 log.cc:824] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:08.925942 8021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: No bootstrap required, opened a new log
I20260812 00:28:08.933856 8021 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } }
I20260812 00:28:08.934258 8021 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:08.934379 8021 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb743aa935747e0b95dc4cd20207112, State: Initialized, Role: FOLLOWER
I20260812 00:28:08.934983 8021 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } }
I20260812 00:28:08.935981 8031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } } }
I20260812 00:28:08.936277 8031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:28:08.937084 8021 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:28:08.947805 8050 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:28:08.947983 8050 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:28:08.950968 7924 master_runner.cc:428] Detected that this master 3bb743aa935747e0b95dc4cd20207112 is joining an existing cluster
I20260812 00:28:08.951120 7924 master_runner.cc:432] Initiating AddMaster RPC to add 127.29.190.189:35947
WARNING: no policy specified for oryx/127.29.190.188@KRBTEST.COM; defaulting to no policy
I20260812 00:28:08.980898 8027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.959777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48976 (local address 127.29.190.190:36827)
0812 00:28:08.959998 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:08.960006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:08.960992 (+ 986us) server_negotiation.cc:407] Connection header received
0812 00:28:08.961206 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:08.961214 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:08.961338 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:08.961502 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:08.963728 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.965352 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.968252 (+ 2900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.969048 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.969228 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.972577 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:08.972588 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:08.972594 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:08.972645 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:08.976791 (+ 4146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.977894 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.977904 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.977908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.978091 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.978619 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.978625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.978628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.979053 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:08.979211 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:08.980033 (+ 822us) server_negotiation.cc:299] Negotiation successful
0812 00:28:08.980317 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:28:08.982184 8058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.959363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:48976)
0812 00:28:08.960822 (+ 1459us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:08.960850 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:08.961034 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:08.961774 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:08.961783 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:08.962819 (+ 1036us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:08.963394 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.963414 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.965621 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.965630 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.968051 (+ 2421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.968066 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.969619 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.969625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.969856 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.970906 (+ 1050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:08.970937 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:08.972271 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:08.976971 (+ 4700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.976977 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.976981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.977728 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.978271 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.978281 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.978285 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.978480 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.979315 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:08.979321 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:08.979675 (+ 354us) client_negotiation.cc:769] Sending connection context
0812 00:28:08.981225 (+ 1550us) client_negotiation.cc:240] Negotiation successful
0812 00:28:08.981679 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1300,"thread_start_us":1115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.188@KRBTEST.COM" created.
I20260812 00:28:08.986451 8059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.961072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.0.0.1:60884)
0812 00:28:08.967879 (+ 6807us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:08.967901 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:08.968312 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:08.968763 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:08.968768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:08.970504 (+ 1736us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:08.970938 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.970953 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.972623 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.972628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.974481 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.974506 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.975996 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.976006 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.976220 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.976928 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:08.976966 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:08.978458 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:08.983198 (+ 4740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.983205 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.983213 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.983864 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.984351 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:08.984354 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:08.984356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:08.984518 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:08.985168 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:08.985174 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:08.985326 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 00:28:08.985481 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 00:28:08.985862 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6644,"thread_start_us":6911,"threads_started":1}
I20260812 00:28:08.987164 8026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.959309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60884 (local address 127.29.190.189:35947)
0812 00:28:08.959587 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:08.959595 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:08.968002 (+ 8407us) server_negotiation.cc:407] Connection header received
0812 00:28:08.968438 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:08.968443 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:08.968511 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:08.968577 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:08.971124 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.972399 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.974670 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.975543 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.975652 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:08.978660 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:08.978669 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:08.978675 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:08.978718 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:08.983042 (+ 4324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.984062 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.984069 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.984072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.984242 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:08.984643 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:08.984649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:08.984653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:08.985024 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:08.985214 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:08.985582 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 00:28:08.986324 (+ 742us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":489,"server-negotiator.queue_time_us":65}
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494486, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.190@KRBTEST.COM for oryx/127.29.190.189@KRBTEST.COM
I20260812 00:28:09.015152 8026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.994150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60888 (local address 127.29.190.189:35947)
0812 00:28:08.994403 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:08.994413 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:08.995286 (+ 873us) server_negotiation.cc:407] Connection header received
0812 00:28:08.995870 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:08.995876 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:08.995984 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:08.996148 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:08.997519 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.998387 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.000105 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.001113 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.001301 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.006462 (+ 5161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.006469 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.006476 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.006536 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.010899 (+ 4363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.012246 (+ 1347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.012253 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.012256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.012435 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.013035 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.013042 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.013053 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.013489 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.013657 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.014480 (+ 823us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.014741 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260812 00:28:09.015552 8062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:08.994151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.0.0.1:60888)
0812 00:28:08.995121 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:08.995176 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:08.995593 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:08.996206 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:08.996215 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:08.997021 (+ 806us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:08.997307 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.997319 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:08.998570 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:08.998580 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:08.999892 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:08.999908 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.001332 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.001340 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.001574 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.002444 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.002472 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.006162 (+ 3690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.011080 (+ 4918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.011105 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.011115 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.012071 (+ 956us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.012601 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.012610 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.012618 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.012869 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.013687 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.013702 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.014030 (+ 328us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.014326 (+ 296us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.014869 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":487,"threads_started":1}
I20260812 00:28:09.018275 7225 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.29.190.189:35947: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3bb743aa935747e0b95dc4cd20207112"
member_type: NON_VOTER
last_known_addr {
host: "127.29.190.189"
port: 35947
}
attrs {
promote: true
}
}
dest_uuid: "909aa1c69f91424a848cd6df1ac9b4a8"
cas_config_opid_index: -1
I20260812 00:28:09.019666 7225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } }
I20260812 00:28:09.023630 8066 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3bb743aa935747e0b95dc4cd20207112 (127.29.190.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } }
I20260812 00:28:09.024874 7982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.188.keytab.
Entry for principal oryx/127.29.190.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.188.keytab.
I20260812 00:28:09.028180 8066 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.29.190.189:35947
I20260812 00:28:09.028311 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.188:41217
--webserver_interface=127.29.190.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.188.keytab
--principal=oryx/127.29.190.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:36827,127.29.190.189:35947,127.29.190.188:41217
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:28:09.028703 7982 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Refusing update from remote peer 909aa1c69f91424a848cd6df1ac9b4a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 00:28:09.028962 8066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } }
I20260812 00:28:09.029227 8066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:09.035207 7924 master.cc:537] Master@127.29.190.189:35947 shutting down...
I20260812 00:28:09.037139 8066 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 00:28:09.043218 7208 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260812 00:28:09.052999 7924 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:09.053639 7924 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:09.053886 7924 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: stopping tablet replica
W20260812 00:28:09.059538 7208 consensus_peers.cc:487] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 -> Peer 3bb743aa935747e0b95dc4cd20207112 (127.29.190.189:35947): Couldn't send request to peer 3bb743aa935747e0b95dc4cd20207112. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:28:09.062460 7924 master.cc:552] Master@127.29.190.189:35947 shutdown complete.
I20260812 00:28:09.062664 7924 master_runner.cc:305] Clearing existing system tablet
I20260812 00:28:09.063122 7924 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:09.063243 7924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:09.065623 7924 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:28:09.067238 8073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:09.067610 7924 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:09.067926 7924 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 00:28:09.068018 7924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
uuid: "3bb743aa935747e0b95dc4cd20207112"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "5ff03b774497d9366d9a3421b54d7042"
server_key_iv: "ee23fdf0824662e6079fe3408f64dc2d"
server_key_version: "encryptionkey@0"
I20260812 00:28:09.072130 7924 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:09.077397 7924 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:28:09.077625 7924 log.cc:1196] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 00:28:09.078169 7924 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Deleting consensus metadata
I20260812 00:28:09.078451 7924 master_runner.cc:315] Copying system tablet from 127.29.190.190:36827
I20260812 00:28:09.081243 7924 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.190:36827
I20260812 00:28:09.096223 8082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.082072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:48988)
0812 00:28:09.082754 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.082776 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.082964 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.083376 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.083381 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.083807 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.084037 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.084048 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.085151 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.085162 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.086091 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.086103 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.087164 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.087172 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.087410 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.088299 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.088319 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.089168 (+ 849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.093077 (+ 3909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.093085 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.093090 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.093639 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.094063 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.094071 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.094075 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.094263 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.094952 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.094957 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.095136 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.095297 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.095719 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":439,"threads_started":1}
I20260812 00:28:09.098727 8027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.082106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48988 (local address 127.29.190.190:36827)
0812 00:28:09.082346 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.082356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.082892 (+ 536us) server_negotiation.cc:407] Connection header received
0812 00:28:09.083126 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.083132 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.083214 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.083339 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.084206 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.084964 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.086246 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.086939 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.087147 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.089423 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.089430 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.089442 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.089488 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.092861 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.093784 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.093791 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.093795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.093935 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.094384 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.094391 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.094394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.094824 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.094990 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.095407 (+ 417us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.095677 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:28:09.099608 7254 tablet_copy_service.cc:140] P 909aa1c69f91424a848cd6df1ac9b4a8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3bb743aa935747e0b95dc4cd20207112 ({username='oryx', principal='oryx/127.29.190.189@KRBTEST.COM'} at 127.0.0.1:48988)
I20260812 00:28:09.099922 7254 tablet_copy_service.cc:161] P 909aa1c69f91424a848cd6df1ac9b4a8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3bb743aa935747e0b95dc4cd20207112 at {username='oryx', principal='oryx/127.29.190.189@KRBTEST.COM'} at 127.0.0.1:48988: session id = 3bb743aa935747e0b95dc4cd20207112-00000000000000000000000000000000
I20260812 00:28:09.103160 7254 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:28:09.105329 7924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:28:09.110920 7924 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: tablet copy: Starting download of 0 data blocks...
I20260812 00:28:09.111265 7924 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: tablet copy: Starting download of 1 WAL segments...
I20260812 00:28:09.114037 7924 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:28:09.117533 7254 tablet_copy_service.cc:342] P 909aa1c69f91424a848cd6df1ac9b4a8: Request end of tablet copy session 3bb743aa935747e0b95dc4cd20207112-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.29.190.189@KRBTEST.COM'} at 127.0.0.1:48988
I20260812 00:28:09.117769 7254 tablet_copy_service.cc:433] P 909aa1c69f91424a848cd6df1ac9b4a8: ending tablet copy session 3bb743aa935747e0b95dc4cd20207112-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3bb743aa935747e0b95dc4cd20207112
I20260812 00:28:09.129204 7924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:09.132737 8083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:09.135643 8084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:09.148077 8087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:09.151090 7924 server_base.cc:1034] running on GCE node
I20260812 00:28:09.151685 7924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:09.152472 7924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:09.153728 7924 hybrid_clock.cc:648] HybridClock initialized: now 1786494489153621 us; error 57 us; skew 500 ppm
I20260812 00:28:09.153992 7924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494489, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:09.156071 7924 init.cc:377] Logged in from keytab as oryx/127.29.190.189@KRBTEST.COM (short username oryx)
I20260812 00:28:09.157438 7924 webserver.cc:460] Webserver started at http://127.29.190.189:45929/ using document root <none> and password file <none>
I20260812 00:28:09.157791 7924 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:09.157894 7924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:09.160435 7924 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:28:09.162192 8099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:09.162647 7924 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260812 00:28:09.162811 7924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
uuid: "3bb743aa935747e0b95dc4cd20207112"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "5ff03b774497d9366d9a3421b54d7042"
server_key_iv: "ee23fdf0824662e6079fe3408f64dc2d"
server_key_version: "encryptionkey@0"
I20260812 00:28:09.162983 7924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:09.178510 7924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:09.182660 7924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:09.215911 7924 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.189:35947
I20260812 00:28:09.215911 8172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.189:35947 every 8 connection(s)
I20260812 00:28:09.216930 7924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
I20260812 00:28:09.224581 8174 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:28:09.227365 8174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Bootstrap starting.
I20260812 00:28:09.241039 8174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:28:09.241581 8174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: Bootstrap complete.
I20260812 00:28:09.242523 8174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } }
I20260812 00:28:09.242808 8174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3bb743aa935747e0b95dc4cd20207112, State: Initialized, Role: LEARNER
I20260812 00:28:09.243100 8174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } }
I20260812 00:28:09.244342 8178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } }
I20260812 00:28:09.244683 8174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:09.244726 8178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:28:09.253067 8201 catalog_manager.cc:1259] Loaded cluster ID: aa623a1f0b844db4bba89df78bfa3a50
I20260812 00:28:09.253199 8201 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: loading cluster ID for follower catalog manager: success
I20260812 00:28:09.255713 8201 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: acquiring CA information for follower catalog manager: success
I20260812 00:28:09.257591 8201 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:28:09.313498 7917 heartbeater.cc:503] Master 127.29.190.190:36827 was elected leader, sending a full tablet report...
W20260812 00:28:09.513043 8069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:09.513433 8069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:09.513628 8069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:09.522509 8069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:09.522697 8069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:09.522809 8069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:09.522917 8069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:09.523000 8069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:09.533901 8069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:36827,127.29.190.189:35947,127.29.190.188:41217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.188.keytab
--principal=oryx/127.29.190.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.188:41217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.190.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:09.535389 8069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:09.536832 8069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:09.551811 8209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:09.551851 8213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:09.552186 8210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:09.552870 8069 server_base.cc:1034] running on GCE node
I20260812 00:28:09.553716 8069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:09.555294 8069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:09.556542 8069 hybrid_clock.cc:648] HybridClock initialized: now 1786494489556468 us; error 91 us; skew 500 ppm
I20260812 00:28:09.557013 8069 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494489, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:09.560807 8069 init.cc:377] Logged in from keytab as oryx/127.29.190.188@KRBTEST.COM (short username oryx)
I20260812 00:28:09.562443 8069 webserver.cc:460] Webserver started at http://127.29.190.188:45169/ using document root <none> and password file <none>
I20260812 00:28:09.563241 8069 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:09.563411 8069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:09.563808 8069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:09.567137 8069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data/instance:
uuid: "c13cfb50f86844f08053b903f99ff236"
format_stamp: "Formatted at 2026-08-12 00:28:09 on dist-test-slave-c12x"
server_key: "afc145739f46e88ad25e3549a0a8bcf1"
server_key_iv: "d23c27b81d8b4399b043b38f2267f5a9"
server_key_version: "encryptionkey@0"
I20260812 00:28:09.568045 8069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal/instance:
uuid: "c13cfb50f86844f08053b903f99ff236"
format_stamp: "Formatted at 2026-08-12 00:28:09 on dist-test-slave-c12x"
server_key: "afc145739f46e88ad25e3549a0a8bcf1"
server_key_iv: "d23c27b81d8b4399b043b38f2267f5a9"
server_key_version: "encryptionkey@0"
I20260812 00:28:09.574052 8069 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:28:09.577809 8229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:09.579403 8069 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:09.579686 8069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
uuid: "c13cfb50f86844f08053b903f99ff236"
format_stamp: "Formatted at 2026-08-12 00:28:09 on dist-test-slave-c12x"
server_key: "afc145739f46e88ad25e3549a0a8bcf1"
server_key_iv: "d23c27b81d8b4399b043b38f2267f5a9"
server_key_version: "encryptionkey@0"
I20260812 00:28:09.579931 8069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:09.596994 8069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:09.601643 8069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:09.601969 8069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:09.614324 8241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.604975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.29.190.189:35947)
0812 00:28:09.605702 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.605709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.605742 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:28:09.605830 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.605836 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.605942 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.606132 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:09.606711 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.608574 (+ 1863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.611164 (+ 2590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.613012 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.613316 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.613623 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.613801 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.613954 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":380,"threads_started":1}
I20260812 00:28:09.614313 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.604698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.0.0.1:60894)
0812 00:28:09.605264 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.605294 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.605516 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.606208 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.606212 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.606286 (+ 74us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:09.606541 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.606555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.608794 (+ 2239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.608799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.610898 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.610926 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.613326 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.613333 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.613533 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.613589 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.613760 (+ 171us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.613940 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":257,"threads_started":1}
I20260812 00:28:09.616698 8139 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260812 00:28:09.617730 8178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 909aa1c69f91424a848cd6df1ac9b4a8. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } }
I20260812 00:28:09.618043 8178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:28:09.641443 8069 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.188:41217
I20260812 00:28:09.641481 8300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.188:41217 every 8 connection(s)
I20260812 00:28:09.642916 8069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
I20260812 00:28:09.644213 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 8069
I20260812 00:28:09.648401 8302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:09.655406 8302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.188@KRBTEST.COM
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494489, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.188@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:09.670080 8306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.646318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52500 (local address 127.29.190.188:41217)
0812 00:28:09.647197 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.647213 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.647718 (+ 505us) server_negotiation.cc:407] Connection header received
0812 00:28:09.649703 (+ 1985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.649725 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.650089 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.650545 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.652249 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.653648 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.654911 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.655702 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.655921 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.661060 (+ 5139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.661068 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.661081 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.661126 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.665132 (+ 4006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.665994 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.666001 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.666007 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.666239 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.666665 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.666675 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.666680 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.667422 (+ 742us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.667937 (+ 515us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.668362 (+ 425us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.668845 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":405,"threads_started":1}
I20260812 00:28:09.676524 8313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.658285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48992 (local address 127.29.190.190:36827)
0812 00:28:09.659591 (+ 1306us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.659595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.659612 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:28:09.659662 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.659666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.659732 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.659874 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.661405 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.662670 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.664837 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.665371 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.665529 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.669463 (+ 3934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.669469 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.669472 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.669512 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.673547 (+ 4035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.674248 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.674252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.674254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.674392 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.674860 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.674864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.674866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.675157 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.675286 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.675904 (+ 618us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.676089 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1127,"thread_start_us":1035,"threads_started":1}
I20260812 00:28:09.676540 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.658111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:48992)
0812 00:28:09.658936 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.658977 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.659139 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.659977 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.659986 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.660855 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.661223 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.661232 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.662877 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.662881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.664660 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.664677 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.665571 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.665576 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.665701 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.666284 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.666319 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.669208 (+ 2889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.673681 (+ 4473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.673690 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.673696 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.674130 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.674561 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.674566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.674568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.674727 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.675296 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.675303 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.675573 (+ 270us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.675759 (+ 186us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.676051 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":433,"threads_started":1}
I20260812 00:28:09.678251 8302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494489, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.188@KRBTEST.COM for oryx/127.29.190.189@KRBTEST.COM
I20260812 00:28:09.693138 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.679133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.0.0.1:60898)
0812 00:28:09.679370 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.679387 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.679587 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.679963 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.679967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.680293 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.680471 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.680480 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.681499 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.681504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.682545 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.682559 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.683283 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.683288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.683423 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.684247 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.684266 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.686592 (+ 2326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.689768 (+ 3176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.689772 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.689775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.690318 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.690988 (+ 670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.690997 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.691001 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.691195 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.691959 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.691984 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.692241 (+ 257us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.692442 (+ 201us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.692775 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 00:28:09.693344 8241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.679118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60898 (local address 127.29.190.189:35947)
0812 00:28:09.679331 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.679339 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.679503 (+ 164us) server_negotiation.cc:407] Connection header received
0812 00:28:09.679703 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.679707 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.679771 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.679853 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.680631 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.681322 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.682694 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.683117 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.683213 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.686819 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.686824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.686828 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.686871 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.689618 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.690614 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.690620 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.690623 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.690860 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.691334 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.691342 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.691346 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.691778 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.691947 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.692597 (+ 650us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.692923 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:28:09.694415 8302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494489, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.188@KRBTEST.COM for oryx/127.29.190.188@KRBTEST.COM
I20260812 00:28:09.707747 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.695078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:41217 (local address 127.0.0.1:52504)
0812 00:28:09.695303 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.695319 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.695398 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.695726 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.695730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.696097 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.696243 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.696251 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.697291 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.697295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.698133 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.698143 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.698842 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.698846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.698985 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.699649 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.699666 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.701740 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.704795 (+ 3055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.704799 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.704802 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.705161 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.705580 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.705586 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.705594 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.705765 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.706477 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.706526 (+ 49us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.706709 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.706931 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.707222 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 00:28:09.707862 8306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.695221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52504 (local address 127.29.190.188:41217)
0812 00:28:09.695459 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.695466 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.695490 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:28:09.695545 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.695548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.695606 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.695689 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.696391 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.697169 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.698271 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.698699 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.698799 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.701948 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.701954 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.701957 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.701986 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.704648 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.705270 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.705274 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.705276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.705396 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.705953 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.705957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.705959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.706252 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.706435 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.707013 (+ 578us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.707384 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":145,"server-negotiator.queue_time_us":57}
I20260812 00:28:09.713035 8302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Bootstrap starting.
I20260812 00:28:09.716288 8302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:09.717363 8302 log.cc:824] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:09.720765 8302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: No bootstrap required, opened a new log
I20260812 00:28:09.728432 8302 raft_consensus.cc:348] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } }
I20260812 00:28:09.728770 8302 raft_consensus.cc:374] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:09.728935 8302 raft_consensus.cc:729] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c13cfb50f86844f08053b903f99ff236, State: Initialized, Role: FOLLOWER
I20260812 00:28:09.729578 8302 consensus_queue.cc:260] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } }
I20260812 00:28:09.730600 8317 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } } }
I20260812 00:28:09.730985 8317 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:28:09.731803 8302 sys_catalog.cc:564] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:28:09.742547 8331 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:28:09.743559 8331 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:28:09.747767 8069 master_runner.cc:428] Detected that this master c13cfb50f86844f08053b903f99ff236 is joining an existing cluster
I20260812 00:28:09.747931 8069 master_runner.cc:432] Initiating AddMaster RPC to add 127.29.190.188:41217
I20260812 00:28:09.775924 8313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.753138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49000 (local address 127.29.190.190:36827)
0812 00:28:09.753387 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.753397 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.756220 (+ 2823us) server_negotiation.cc:407] Connection header received
0812 00:28:09.756555 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.756562 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.756659 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.756742 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.758941 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.760733 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.764149 (+ 3416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.764844 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.764991 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.768340 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.768347 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.768354 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.768402 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.772275 (+ 3873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.773261 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.773268 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.773271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.773438 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.773970 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.773976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.773980 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.774357 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.774510 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.775245 (+ 735us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.775541 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:28:09.777292 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 7317
I20260812 00:28:09.777321 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.752696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49000)
0812 00:28:09.756097 (+ 3401us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.756123 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.756356 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.757063 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.757072 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.758134 (+ 1062us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.758681 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.758701 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.761058 (+ 2357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.761068 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.763830 (+ 2762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.763856 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.765105 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.765115 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.765393 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.766371 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.766404 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.768084 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.772465 (+ 4381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.772470 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.772475 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.773102 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.773601 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.773605 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.773610 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.773825 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.774596 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.774602 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.774825 (+ 223us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.776438 (+ 1613us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.776815 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3226,"thread_start_us":3057,"threads_started":1}
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.129@KRBTEST.COM
I20260812 00:28:09.792626 8241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.752708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60912 (local address 127.29.190.189:35947)
0812 00:28:09.752914 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.752921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.763872 (+ 10951us) server_negotiation.cc:407] Connection header received
0812 00:28:09.771642 (+ 7770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.771650 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.771751 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.771833 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.773987 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.775138 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.777494 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.778183 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.778284 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.781110 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.781118 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.781123 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.781166 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.788230 (+ 7064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.789380 (+ 1150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.789389 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.789396 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.789617 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.790209 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.790217 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.790223 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.790758 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.790926 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.791751 (+ 825us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.792084 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:28:09.794095 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.752810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.0.0.1:60912)
0812 00:28:09.763712 (+ 10902us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.763729 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.763914 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.772082 (+ 8168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.772088 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.773309 (+ 1221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.773795 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.773806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.775642 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.775647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.777289 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.777309 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.778779 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.778784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.778967 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.779679 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.779700 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.780857 (+ 1157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.788490 (+ 7633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.788498 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.788505 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.789175 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.789803 (+ 628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.789811 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.789817 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.790051 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.791035 (+ 984us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.791042 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.791334 (+ 292us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.792963 (+ 1629us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.793513 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10759,"mutex_wait_us":25,"thread_start_us":10479,"threads_started":1}
I20260812 00:28:09.799651 8306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.756385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52516 (local address 127.29.190.188:41217)
0812 00:28:09.756598 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.756603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.768252 (+ 11649us) server_negotiation.cc:407] Connection header received
0812 00:28:09.768613 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.768618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.768689 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.768807 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.769868 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.770827 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.772838 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.773613 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.773800 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.782750 (+ 8950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.782758 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.782762 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.782806 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.786855 (+ 4049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.794255 (+ 7400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.794261 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.794264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.794432 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.794858 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.794863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.794866 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.797952 (+ 3086us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.798192 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.798865 (+ 673us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.799127 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2621,"server-negotiator.queue_time_us":79}
I20260812 00:28:09.800916 8342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.756727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:41217 (local address 127.0.0.1:52516)
0812 00:28:09.768164 (+ 11437us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.768184 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.768473 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.768829 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.768833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.769444 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.769715 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.769723 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.771041 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.771045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.772682 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.772701 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.774110 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.774116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.774286 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.774967 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.774990 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.782539 (+ 7549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.793022 (+ 10483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.793030 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.793033 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.794120 (+ 1087us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.794584 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.794590 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.794593 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.794746 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.798262 (+ 3516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.798274 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.798524 (+ 250us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.799857 (+ 1333us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.800278 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11287,"thread_start_us":11541,"threads_started":1}
I20260812 00:28:09.805109 8343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.778770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49518 (local address 127.29.190.129:34785)
0812 00:28:09.779530 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.779540 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.779572 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:28:09.779644 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.779653 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.779960 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.781963 (+ 2003us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.782277 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.784135 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.786601 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.787657 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.794023 (+ 6366us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.795770 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.795785 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.795806 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.795844 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.800319 (+ 4475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.801451 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.801462 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.801465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.801640 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.802478 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.802485 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.802489 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.802962 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.804424 (+ 1462us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.804583 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.804801 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":3449,"threads_started":1}
Aug 12 00:28:09 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494486, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.190@KRBTEST.COM for oryx/127.29.190.188@KRBTEST.COM
I20260812 00:28:09.807106 7515 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:09.816588 8348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.787073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52522 (local address 127.29.190.188:41217)
0812 00:28:09.793951 (+ 6878us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.793957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.793979 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:28:09.794092 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.794097 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.794207 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.794333 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.798110 (+ 3777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.799735 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.802216 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.803050 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.803858 (+ 808us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.808594 (+ 4736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.808604 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.808610 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.808667 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.812335 (+ 3668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.813546 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.813557 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.813570 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.813794 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.814406 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.814414 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.814420 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.814938 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.815082 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.815792 (+ 710us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.816079 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6717,"thread_start_us":6533,"threads_started":1}
I20260812 00:28:09.817636 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.786014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:41217 (local address 127.0.0.1:52522)
0812 00:28:09.786270 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.786289 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.786397 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.794455 (+ 8058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.794464 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.795046 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.795260 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.795270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.800029 (+ 4759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.800036 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.801634 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.801651 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.803250 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.803258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.803503 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.804237 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.804266 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.808162 (+ 3896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.812564 (+ 4402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.812579 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.812586 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.813349 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.814004 (+ 655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.814013 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.814020 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.814239 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.815194 (+ 955us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.815199 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.815403 (+ 204us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.816836 (+ 1433us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.817208 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260812 00:28:09.819389 7225 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.29.190.188:41217: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c13cfb50f86844f08053b903f99ff236"
member_type: NON_VOTER
last_known_addr {
host: "127.29.190.188"
port: 41217
}
attrs {
promote: true
}
}
dest_uuid: "909aa1c69f91424a848cd6df1ac9b4a8"
cas_config_opid_index: 5
I20260812 00:28:09.820844 7225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } }
I20260812 00:28:09.822835 8237 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c13cfb50f86844f08053b903f99ff236 (127.29.190.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.823587 8139 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 LEARNER]: Refusing update from remote peer 909aa1c69f91424a848cd6df1ac9b4a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:28:09.826776 8351 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 00:28:09.827666 8268 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:09.830099 8139 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c13cfb50f86844f08053b903f99ff236 (127.29.190.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.830753 8268 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Refusing update from remote peer 909aa1c69f91424a848cd6df1ac9b4a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 00:28:09.831353 8237 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.29.190.188:41217
I20260812 00:28:09.831609 8351 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:09.832041 8350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.832502 8350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:09.834146 8069 master.cc:537] Master@127.29.190.188:41217 shutting down...
I20260812 00:28:09.835594 8237 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: attempting to promote NON_VOTER 3bb743aa935747e0b95dc4cd20207112 to VOTER
I20260812 00:28:09.835831 8178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: NON_VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: true } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.836170 8178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:28:09.836398 8237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } }
W20260812 00:28:09.847802 7205 consensus_peers.cc:487] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 -> Peer c13cfb50f86844f08053b903f99ff236 (127.29.190.188:41217): Couldn't send request to peer c13cfb50f86844f08053b903f99ff236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 00:28:09.851903 8139 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 LEARNER]: Refusing update from remote peer 909aa1c69f91424a848cd6df1ac9b4a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 00:28:09.852643 8237 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 00:28:09.855459 8354 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3bb743aa935747e0b95dc4cd20207112 (127.29.190.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.860325 8350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.860595 8350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:09.861025 8351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.861275 8351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:09.861788 8139 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3bb743aa935747e0b95dc4cd20207112 (127.29.190.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.866091 8178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:09.866355 8178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:28:09.879827 8239 tablet.cc:2369] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:28:09.882226 8069 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:09.882684 8069 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:09.882905 8069 tablet_replica.cc:330] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: stopping tablet replica
I20260812 00:28:09.890265 8069 master.cc:552] Master@127.29.190.188:41217 shutdown complete.
I20260812 00:28:09.890369 8069 master_runner.cc:305] Clearing existing system tablet
I20260812 00:28:09.890774 8069 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:09.890882 8069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:09.894104 8069 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 00:28:09.895959 8359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:09.896410 8069 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:09.896677 8069 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:28:09.896778 8069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
uuid: "c13cfb50f86844f08053b903f99ff236"
format_stamp: "Formatted at 2026-08-12 00:28:09 on dist-test-slave-c12x"
server_key: "afc145739f46e88ad25e3549a0a8bcf1"
server_key_iv: "d23c27b81d8b4399b043b38f2267f5a9"
server_key_version: "encryptionkey@0"
I20260812 00:28:09.901925 8069 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:09.909636 8069 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 00:28:09.909830 8069 log.cc:1196] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 00:28:09.910348 8069 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Deleting consensus metadata
I20260812 00:28:09.910627 8069 master_runner.cc:315] Copying system tablet from 127.29.190.190:36827
I20260812 00:28:09.917286 8069 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: tablet copy: Beginning tablet copy session from remote peer at address 127.29.190.190:36827
I20260812 00:28:09.931087 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 7317
I20260812 00:28:09.935202 8313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.918275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49014 (local address 127.29.190.190:36827)
0812 00:28:09.918585 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:09.918595 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:09.920063 (+ 1468us) server_negotiation.cc:407] Connection header received
0812 00:28:09.920286 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:09.920292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:09.920383 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:09.920498 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:09.921719 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.922917 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.924726 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.925387 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.925536 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.927958 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:09.927965 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:09.927971 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:09.928014 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:09.931673 (+ 3659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.932665 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.932672 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.932675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.932847 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:09.933380 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:09.933389 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:09.933394 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:09.933779 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:09.933947 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:09.934561 (+ 614us) server_negotiation.cc:299] Negotiation successful
0812 00:28:09.934813 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260812 00:28:09.935966 8366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:09.918179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49014)
0812 00:28:09.919906 (+ 1727us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:09.919936 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:09.920109 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:09.920645 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:09.920651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:09.921239 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:09.921522 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.921540 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.923089 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.923095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.924559 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:09.924576 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:09.925596 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:09.925602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:09.925798 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:09.926585 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:09.926612 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:09.927730 (+ 1118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:09.931833 (+ 4103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.931841 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.931848 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.932514 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.932990 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:09.932998 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:09.933005 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:09.933244 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:09.933932 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:09.933940 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:09.934205 (+ 265us) client_negotiation.cc:769] Sending connection context
0812 00:28:09.934397 (+ 192us) client_negotiation.cc:240] Negotiation successful
0812 00:28:09.934996 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1577,"thread_start_us":1445,"threads_started":1}
I20260812 00:28:09.936656 7254 tablet_copy_service.cc:140] P 909aa1c69f91424a848cd6df1ac9b4a8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c13cfb50f86844f08053b903f99ff236 ({username='oryx', principal='oryx/127.29.190.188@KRBTEST.COM'} at 127.0.0.1:49014)
I20260812 00:28:09.936841 7254 tablet_copy_service.cc:161] P 909aa1c69f91424a848cd6df1ac9b4a8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c13cfb50f86844f08053b903f99ff236 at {username='oryx', principal='oryx/127.29.190.188@KRBTEST.COM'} at 127.0.0.1:49014: session id = c13cfb50f86844f08053b903f99ff236-00000000000000000000000000000000
I20260812 00:28:09.940610 7254 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 00:28:09.942775 8069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 00:28:09.951539 8069 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: tablet copy: Starting download of 0 data blocks...
I20260812 00:28:09.951887 8069 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: tablet copy: Starting download of 1 WAL segments...
I20260812 00:28:09.954751 8069 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 00:28:09.959594 7254 tablet_copy_service.cc:342] P 909aa1c69f91424a848cd6df1ac9b4a8: Request end of tablet copy session c13cfb50f86844f08053b903f99ff236-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.29.190.188@KRBTEST.COM'} at 127.0.0.1:49014
I20260812 00:28:09.959766 7254 tablet_copy_service.cc:433] P 909aa1c69f91424a848cd6df1ac9b4a8: ending tablet copy session c13cfb50f86844f08053b903f99ff236-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c13cfb50f86844f08053b903f99ff236
I20260812 00:28:09.964298 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:34785
--local_ip_for_outbound_sockets=127.29.190.129
--tserver_master_addrs=127.29.190.190:36827
--webserver_port=42375
--webserver_interface=127.29.190.129
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab
--principal=oryx/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947,127.29.190.188:41217 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:28:09.973908 8069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:09.977064 8369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:09.982188 8372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:09.997682 8374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:10.001181 8069 server_base.cc:1034] running on GCE node
I20260812 00:28:10.001616 8069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:10.002414 8069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:10.003618 8069 hybrid_clock.cc:648] HybridClock initialized: now 1786494490003564 us; error 48 us; skew 500 ppm
I20260812 00:28:10.003877 8069 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:10 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494490, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:10.006385 8069 init.cc:377] Logged in from keytab as oryx/127.29.190.188@KRBTEST.COM (short username oryx)
I20260812 00:28:10.020637 8069 webserver.cc:460] Webserver started at http://127.29.190.188:35137/ using document root <none> and password file <none>
I20260812 00:28:10.021016 8069 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:10.021126 8069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:10.024518 8069 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 00:28:10.026503 8384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:10.027029 8069 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 00:28:10.027169 8069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
uuid: "c13cfb50f86844f08053b903f99ff236"
format_stamp: "Formatted at 2026-08-12 00:28:09 on dist-test-slave-c12x"
server_key: "afc145739f46e88ad25e3549a0a8bcf1"
server_key_iv: "d23c27b81d8b4399b043b38f2267f5a9"
server_key_version: "encryptionkey@0"
I20260812 00:28:10.027382 8069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:10.045748 8069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:10.050305 8069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:10.097673 8463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.188:41217 every 8 connection(s)
I20260812 00:28:10.097673 8069 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.188:41217
I20260812 00:28:10.098730 8069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
I20260812 00:28:10.106245 8464 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:28:10.109468 8464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Bootstrap starting.
I20260812 00:28:10.124069 8464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:28:10.124651 8464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Bootstrap complete.
I20260812 00:28:10.125574 8464 raft_consensus.cc:348] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } }
I20260812 00:28:10.125840 8464 raft_consensus.cc:729] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c13cfb50f86844f08053b903f99ff236, State: Initialized, Role: LEARNER
I20260812 00:28:10.126106 8464 consensus_queue.cc:260] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } }
I20260812 00:28:10.126951 8467 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:10.127321 8464 sys_catalog.cc:564] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:10.127475 8467 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: This master's current role is: LEARNER
I20260812 00:28:10.139111 8484 catalog_manager.cc:1259] Loaded cluster ID: aa623a1f0b844db4bba89df78bfa3a50
I20260812 00:28:10.139258 8484 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: loading cluster ID for follower catalog manager: success
I20260812 00:28:10.141840 8484 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: acquiring CA information for follower catalog manager: success
I20260812 00:28:10.143847 8484 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:28:10.371855 8490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.351034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:41217 (local address 127.0.0.1:52536)
0812 00:28:10.363323 (+ 12289us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:10.363355 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:10.364143 (+ 788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:10.365342 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:10.365348 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:10.365383 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:10.365635 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:10.365646 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.367817 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.367821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:10.369152 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:10.369167 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.371055 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.371060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:10.371193 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.371219 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:28:10.371287 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 00:28:10.371392 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12110,"thread_start_us":11969,"threads_started":1}
I20260812 00:28:10.372259 8492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.351165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52536 (local address 127.29.190.188:41217)
0812 00:28:10.364827 (+ 13662us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:10.364836 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:10.364870 (+ 34us) server_negotiation.cc:407] Connection header received
0812 00:28:10.364984 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:10.364992 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:10.365121 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:10.365283 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:10.365838 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.367655 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.369343 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.370840 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.371106 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.371349 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:10.371422 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 00:28:10.371799 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13483,"thread_start_us":13290,"threads_started":1}
I20260812 00:28:10.373433 8435 raft_consensus.cc:1203] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 00:28:10.374197 8467 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 909aa1c69f91424a848cd6df1ac9b4a8. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:10.374704 8467 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: This master's current role is: LEARNER
W20260812 00:28:10.426175 8367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:10.426728 8367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:10.426971 8367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:10.435989 8367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:10.436131 8367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:10.436365 8367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:10.447325 8367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab
--principal=oryx/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:34785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=42375
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947,127.29.190.188:41217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:10.448945 8367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:10.450404 8367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:10.464790 8500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:10.465080 8504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:10.464871 8501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:10.466076 8367 server_base.cc:1034] running on GCE node
I20260812 00:28:10.466684 8367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:10.467998 8367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:10.469280 8367 hybrid_clock.cc:648] HybridClock initialized: now 1786494490469178 us; error 85 us; skew 500 ppm
I20260812 00:28:10.469663 8367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:10 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494490, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:10.473402 8367 init.cc:377] Logged in from keytab as oryx/127.29.190.129@KRBTEST.COM (short username oryx)
I20260812 00:28:10.475226 8367 webserver.cc:460] Webserver started at http://127.29.190.129:42375/ using document root <none> and password file <none>
I20260812 00:28:10.476058 8367 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:10.476192 8367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:10.482249 8367 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260812 00:28:10.485384 8513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:10.486976 8367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:10.487229 8367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "1715ce364f664f9eb906915c20b88dee"
format_stamp: "Formatted at 2026-08-12 00:28:07 on dist-test-slave-c12x"
server_key: "1608ea4d0b986e19900417bed64a056e"
server_key_iv: "3490fe82a5774229880bb9865c144d8b"
server_key_version: "encryptionkey@0"
I20260812 00:28:10.488502 8367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:10.524394 8367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:10.530001 8367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:10.530261 8367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:10.531291 8367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:10.533063 8367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:10.533156 8367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:10.533236 8367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:10.533296 8367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:10.573665 8367 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:34785
I20260812 00:28:10.573710 8691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:34785 every 8 connection(s)
I20260812 00:28:10.575320 8367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:10.583582 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 8367
I20260812 00:28:10.583979 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 7532
Aug 12 00:28:10 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494490, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
Aug 12 00:28:10 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494490, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.189@KRBTEST.COM
Aug 12 00:28:10 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494490, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.188@KRBTEST.COM
I20260812 00:28:10.612437 8492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.582146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:60663 (local address 127.29.190.188:41217)
0812 00:28:10.582390 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:10.582399 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:10.583420 (+ 1021us) server_negotiation.cc:407] Connection header received
0812 00:28:10.591153 (+ 7733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:10.591159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:10.591265 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:10.591378 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:10.595110 (+ 3732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.596340 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.598719 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.599495 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.599610 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.604665 (+ 5055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:10.604673 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:10.604678 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:10.604729 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:10.608521 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:10.609477 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:10.609484 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:10.609488 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:10.609633 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:10.610295 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:10.610301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:10.610305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:10.610720 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:10.610864 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:10.611763 (+ 899us) server_negotiation.cc:299] Negotiation successful
0812 00:28:10.612044 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:28:10.613768 8696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.578657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:47961 (local address 127.29.190.190:36827)
0812 00:28:10.579110 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:10.579115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:10.581166 (+ 2051us) server_negotiation.cc:407] Connection header received
0812 00:28:10.585470 (+ 4304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:10.585482 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:10.585612 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:10.585729 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:10.589614 (+ 3885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.591202 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.595947 (+ 4745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.596690 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.596820 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.602827 (+ 6007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:10.602839 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:10.602848 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:10.602901 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:10.607876 (+ 4975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:10.609043 (+ 1167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:10.609050 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:10.609054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:10.609263 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:10.610296 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:10.610302 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:10.610306 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:10.610739 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:10.610883 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:10.613095 (+ 2212us) server_negotiation.cc:299] Negotiation successful
0812 00:28:10.613350 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":233,"threads_started":1}
I20260812 00:28:10.613897 8707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.582581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:41217 (local address 127.29.190.129:60663)
0812 00:28:10.583287 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:10.583308 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:10.590850 (+ 7542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:10.591718 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:10.591723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:10.593174 (+ 1451us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:10.594725 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:10.594743 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.596546 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.596554 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:10.598526 (+ 1972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:10.598545 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.599955 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.599974 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:10.600227 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.600945 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:10.600970 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:10.604393 (+ 3423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:10.608685 (+ 4292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:10.608691 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:10.608696 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:10.609311 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:10.609907 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:10.609910 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:10.609912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:10.610139 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:10.610970 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:10.610974 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:10.611281 (+ 307us) client_negotiation.cc:769] Sending connection context
0812 00:28:10.611653 (+ 372us) client_negotiation.cc:240] Negotiation successful
0812 00:28:10.612309 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":291,"thread_start_us":356,"threads_started":1}
Aug 12 00:28:10 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.130@KRBTEST.COM
I20260812 00:28:10.615757 8697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.580097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.29.190.129:35823)
0812 00:28:10.581714 (+ 1617us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:10.581743 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:10.585066 (+ 3323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:10.586331 (+ 1265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:10.586349 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:10.587689 (+ 1340us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:10.589281 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:10.589323 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.591568 (+ 2245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.591577 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:10.595762 (+ 4185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:10.595785 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.597362 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.597372 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:10.597719 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.598897 (+ 1178us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:10.598943 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:10.604210 (+ 5267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:10.609773 (+ 5563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:10.609779 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:10.609783 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:10.610700 (+ 917us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:10.612685 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:10.612691 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:10.612696 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:10.612857 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:10.614557 (+ 1700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:10.614565 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:10.614737 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:28:10.614894 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 00:28:10.615212 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1483,"mutex_wait_us":363,"spinlock_wait_cycles":19712,"thread_start_us":404,"threads_started":1}
I20260812 00:28:10.615777 8705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.580143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:35823 (local address 127.29.190.189:35947)
0812 00:28:10.583560 (+ 3417us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:10.583564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:10.583588 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:28:10.585609 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:10.585618 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:10.585753 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:10.589499 (+ 3746us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:10.589768 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.591271 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.596016 (+ 4745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.596934 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.597068 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.604483 (+ 7415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:10.604490 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:10.604495 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:10.604556 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:10.609612 (+ 5056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:10.612164 (+ 2552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:10.612172 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:10.612177 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:10.612343 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:10.613898 (+ 1555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:10.613902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:10.613905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:10.614312 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:10.614469 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:10.615030 (+ 561us) server_negotiation.cc:299] Negotiation successful
0812 00:28:10.615290 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3243,"thread_start_us":3111,"threads_started":1}
I20260812 00:28:10.616214 8704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.579231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.129:47961)
0812 00:28:10.580989 (+ 1758us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:10.581041 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:10.585056 (+ 4015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:10.586332 (+ 1276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:10.586350 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:10.587691 (+ 1341us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:10.589283 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:10.589323 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.591481 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.591487 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:10.595761 (+ 4274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:10.595777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.597229 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.597237 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:10.597598 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.598616 (+ 1018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:10.598659 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:10.602502 (+ 3843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:10.608161 (+ 5659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:10.608172 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:10.608191 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:10.608866 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:10.609787 (+ 921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:10.609792 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:10.609798 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:10.610099 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:10.610868 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:10.610879 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:10.611331 (+ 452us) client_negotiation.cc:769] Sending connection context
0812 00:28:10.611664 (+ 333us) client_negotiation.cc:240] Negotiation successful
0812 00:28:10.613142 (+ 1478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1443,"mutex_wait_us":1190,"spinlock_wait_cycles":3968,"thread_start_us":2062,"threads_started":1}
I20260812 00:28:10.616247 8692 heartbeater.cc:347] Connected to a master server at 127.29.190.188:41217
I20260812 00:28:10.616598 8692 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:10.617107 8694 heartbeater.cc:347] Connected to a master server at 127.29.190.189:35947
I20260812 00:28:10.617264 8694 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:10.617707 8692 heartbeater.cc:511] Master 127.29.190.188:41217 requested a full tablet report, sending...
I20260812 00:28:10.617825 8694 heartbeater.cc:511] Master 127.29.190.189:35947 requested a full tablet report, sending...
I20260812 00:28:10.618181 8693 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36827
I20260812 00:28:10.618312 8693 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:10.618853 8693 heartbeater.cc:511] Master 127.29.190.190:36827 requested a full tablet report, sending...
I20260812 00:28:10.620556 7225 ts_manager.cc:194] Re-registered known tserver with Master: 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785)
I20260812 00:28:10.621035 8417 ts_manager.cc:194] Registered new tserver with Master: 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785)
I20260812 00:28:10.621184 8122 ts_manager.cc:194] Registered new tserver with Master: 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785)
I20260812 00:28:10.621780 7225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:47961
I20260812 00:28:10.625492 8709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:10.585218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45044 (local address 127.29.190.130:44105)
0812 00:28:10.597278 (+ 12060us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:10.597289 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:10.600982 (+ 3693us) server_negotiation.cc:407] Connection header received
0812 00:28:10.601491 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:10.601502 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:10.601829 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:10.602019 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:10.604364 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.606194 (+ 1830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.608632 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:10.609616 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:10.609726 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:10.617437 (+ 7711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:10.617457 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:10.617477 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:10.617536 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:10.621826 (+ 4290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:10.622917 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:10.622927 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:10.622931 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:10.623145 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:10.623690 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:10.623696 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:10.623700 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:10.624192 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:10.624530 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:10.624865 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 00:28:10.625172 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11854,"thread_start_us":12196,"threads_started":1}
I20260812 00:28:10.626873 7713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:10.718410 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 7532
I20260812 00:28:10.744364 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:44105
--local_ip_for_outbound_sockets=127.29.190.130
--tserver_master_addrs=127.29.190.190:36827
--webserver_port=34317
--webserver_interface=127.29.190.130
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab
--principal=oryx/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947,127.29.190.188:41217 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:28:10.881362 8354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: NON_VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: true } } }
I20260812 00:28:10.881726 8354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:10.883419 8714 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: attempting to promote NON_VOTER c13cfb50f86844f08053b903f99ff236 to VOTER
I20260812 00:28:10.884352 8714 consensus_queue.cc:237] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } }
I20260812 00:28:10.886612 8435 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 LEARNER]: Refusing update from remote peer 909aa1c69f91424a848cd6df1ac9b4a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 00:28:10.886615 8139 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Refusing update from remote peer 909aa1c69f91424a848cd6df1ac9b4a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 00:28:10.887288 8713 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 00:28:10.887763 8354 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 00:28:10.891132 8714 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c13cfb50f86844f08053b903f99ff236 (127.29.190.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:10.891987 8139 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c13cfb50f86844f08053b903f99ff236 (127.29.190.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:10.892501 8435 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c13cfb50f86844f08053b903f99ff236 (127.29.190.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:10.895560 8713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:10.895838 8713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:10.896168 8713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:10.896410 8713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:10.896767 8713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:10.897009 8713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:10.899993 8722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:10.900440 8722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:28:10.901106 8723 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:10.901475 8723 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 00:28:11.118796 8712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:11.119163 8712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:11.119338 8712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:11.127339 8712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:11.127528 8712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:11.127731 8712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:11.138182 8712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab
--principal=oryx/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:44105
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=34317
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947,127.29.190.188:41217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:11.139780 8712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:11.141196 8712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:11.156416 8733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:11.156383 8734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:11.156378 8737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:11.157370 8712 server_base.cc:1034] running on GCE node
I20260812 00:28:11.158102 8712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:11.159250 8712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:11.160539 8712 hybrid_clock.cc:648] HybridClock initialized: now 1786494491160478 us; error 66 us; skew 500 ppm
I20260812 00:28:11.160918 8712 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:11 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494491, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:11.164456 8712 init.cc:377] Logged in from keytab as oryx/127.29.190.130@KRBTEST.COM (short username oryx)
I20260812 00:28:11.166033 8712 webserver.cc:460] Webserver started at http://127.29.190.130:34317/ using document root <none> and password file <none>
I20260812 00:28:11.166779 8712 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:11.166963 8712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:11.172533 8712 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 00:28:11.175329 8747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:11.176718 8712 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:28:11.176910 8712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "9a4dc642e03b4bcca9b167edaad716e8"
format_stamp: "Formatted at 2026-08-12 00:28:07 on dist-test-slave-c12x"
server_key: "b16667b872cf83c22dd3c68a5b8c00c3"
server_key_iv: "9b034e353275b079dbb7678fb75457ae"
server_key_version: "encryptionkey@0"
I20260812 00:28:11.177985 8712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:11.219849 8712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:11.224223 8712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:11.224555 8712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:11.225585 8712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:11.227039 8712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:11.227176 8712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:11.227285 8712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:11.227396 8712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:11.263108 8712 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:44105
I20260812 00:28:11.263222 8914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:44105 every 8 connection(s)
I20260812 00:28:11.264698 8712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:11.273607 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 8712
I20260812 00:28:11.273919 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 7724
Aug 12 00:28:11 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494491, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.188@KRBTEST.COM
Aug 12 00:28:11 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494491, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.189@KRBTEST.COM
Aug 12 00:28:11 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494491, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:11.298025 8922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.268987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:42977 (local address 127.29.190.189:35947)
0812 00:28:11.270179 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:11.270184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:11.270201 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:28:11.272455 (+ 2254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:11.272464 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:11.272601 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:11.272750 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:11.278432 (+ 5682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.279726 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.282664 (+ 2938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.283315 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.283416 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:11.289796 (+ 6380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:11.289804 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:11.289809 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:11.289857 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:11.293631 (+ 3774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:11.294669 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:11.294675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:11.294678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:11.294851 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:11.295551 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:11.295557 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:11.295560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:11.295945 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:11.296105 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:11.297306 (+ 1201us) server_negotiation.cc:299] Negotiation successful
0812 00:28:11.297560 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1101,"thread_start_us":969,"threads_started":1}
I20260812 00:28:11.298972 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.267851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:55781 (local address 127.29.190.188:41217)
0812 00:28:11.268334 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:11.268341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:11.270847 (+ 2506us) server_negotiation.cc:407] Connection header received
0812 00:28:11.275768 (+ 4921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:11.275774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:11.275876 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:11.275970 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:11.278469 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.279725 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.283045 (+ 3320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.283741 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.283839 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:11.290661 (+ 6822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:11.290670 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:11.290675 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:11.290721 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:11.295265 (+ 4544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:11.296235 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:11.296241 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:11.296244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:11.296406 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:11.296907 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:11.296912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:11.296916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:11.297321 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:11.297457 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:11.298262 (+ 805us) server_negotiation.cc:299] Negotiation successful
0812 00:28:11.298516 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":235,"threads_started":1}
I20260812 00:28:11.300655 8920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.268452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.29.190.130:42977)
0812 00:28:11.269497 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:11.269559 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:11.272188 (+ 2629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:11.272947 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:11.272954 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:11.273812 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:11.277159 (+ 3347us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x61200002c628. stack: 00007f2ce3b9e66e 00007f2ce3b9e430 00007f2ce2c255ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f2ce3b940fd 00007f2ce3b93d1e 00007f2cf6aa13cd 00007f2cf6aa136c 00007f2ce4ccd757 00007f2cea5a203a 00007f2cea629dca 00007f2cea627f68 00007f2cea65b82f 00007f2cea65b58d
0812 00:28:11.278195 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.278224 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.280072 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.280086 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:11.282387 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.282507 (+ 120us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.283738 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.283742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:11.284082 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:11.285954 (+ 1872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:11.285992 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:11.289502 (+ 3510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:11.293831 (+ 4329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:11.293841 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:11.293861 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:11.294516 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:11.295033 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:11.295039 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:11.295043 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:11.295368 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:11.296215 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:11.296225 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:11.296776 (+ 551us) client_negotiation.cc:769] Sending connection context
0812 00:28:11.298340 (+ 1564us) client_negotiation.cc:240] Negotiation successful
0812 00:28:11.298945 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":193,"spinlock_wait_cycles":4017280,"thread_start_us":348,"threads_started":1}
I20260812 00:28:11.301074 8921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.268452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:41217 (local address 127.29.190.130:55781)
0812 00:28:11.270619 (+ 2167us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:11.270634 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:11.275537 (+ 4903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:11.276266 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:11.276271 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:11.277033 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:11.278195 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.278224 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.279947 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.279952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:11.282889 (+ 2937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.282903 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.284122 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.284128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:11.284331 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:11.285139 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:11.285172 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:11.290413 (+ 5241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:11.295455 (+ 5042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:11.295462 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:11.295466 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:11.296090 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:11.296564 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:11.296568 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:11.296571 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:11.296760 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:11.297566 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:11.297572 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:11.297763 (+ 191us) client_negotiation.cc:769] Sending connection context
0812 00:28:11.299302 (+ 1539us) client_negotiation.cc:240] Negotiation successful
0812 00:28:11.299658 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2037,"mutex_wait_us":855,"spinlock_wait_cycles":39936,"thread_start_us":1773,"threads_started":1}
Aug 12 00:28:11 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.131@KRBTEST.COM
I20260812 00:28:11.302569 8917 heartbeater.cc:347] Connected to a master server at 127.29.190.189:35947
I20260812 00:28:11.302595 8915 heartbeater.cc:347] Connected to a master server at 127.29.190.188:41217
I20260812 00:28:11.302949 8915 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:11.304003 8915 heartbeater.cc:511] Master 127.29.190.188:41217 requested a full tablet report, sending...
I20260812 00:28:11.302950 8917 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:11.304670 8917 heartbeater.cc:511] Master 127.29.190.189:35947 requested a full tablet report, sending...
I20260812 00:28:11.305671 8924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.270917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:48293 (local address 127.29.190.190:36827)
0812 00:28:11.282406 (+ 11489us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:11.282412 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:11.282434 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:28:11.282511 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:11.282517 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:11.282610 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:11.284670 (+ 2060us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:11.287589 (+ 2919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.288669 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.290417 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.291119 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.291905 (+ 786us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:11.297015 (+ 5110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:11.297022 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:11.297026 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:11.297096 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:11.301772 (+ 4676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:11.302746 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:11.302752 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:11.302755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:11.302928 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:11.303416 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:11.303419 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:11.303421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:11.303789 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:11.303971 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:11.304928 (+ 957us) server_negotiation.cc:299] Negotiation successful
0812 00:28:11.305181 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11353,"thread_start_us":15971,"threads_started":1}
I20260812 00:28:11.306123 8417 ts_manager.cc:194] Registered new tserver with Master: 9a4dc642e03b4bcca9b167edaad716e8 (127.29.190.130:44105)
I20260812 00:28:11.306130 8122 ts_manager.cc:194] Registered new tserver with Master: 9a4dc642e03b4bcca9b167edaad716e8 (127.29.190.130:44105)
I20260812 00:28:11.307206 8923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.270803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.130:48293)
0812 00:28:11.271507 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:11.271530 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:11.276711 (+ 5181us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x61200002c628. stack: 00007f2ce3b9e66e 00007f2ce3b9e430 00007f2ce2c255ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f2ce3b940fd 00007f2ce3b93d1e 00007f2cf6aa13cd 00007f2cf6aa136c 00007f2cf6a6db3b 00007f2cea5a3536 00007f2cea5a1d9e 00007f2cea629dca 00007f2cea627f68 00007f2cea65b82f
0812 00:28:11.276749 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:11.284681 (+ 7932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:11.284686 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:11.285307 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:11.285711 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.285725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.288897 (+ 3172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.288904 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:11.290224 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.290242 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.291285 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.291290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:11.291562 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:11.292265 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:11.292288 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:11.296772 (+ 4484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:11.301943 (+ 5171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:11.301949 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:11.301953 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:11.302547 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:11.303077 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:11.303081 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:11.303084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:11.303275 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:11.303937 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:11.303942 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:11.304123 (+ 181us) client_negotiation.cc:769] Sending connection context
0812 00:28:11.304326 (+ 203us) client_negotiation.cc:240] Negotiation successful
0812 00:28:11.304688 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"spinlock_wait_cycles":8875776,"thread_start_us":314,"threads_started":1}
I20260812 00:28:11.308086 8916 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36827
I20260812 00:28:11.308240 8916 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:11.308689 8916 heartbeater.cc:511] Master 127.29.190.190:36827 requested a full tablet report, sending...
I20260812 00:28:11.309857 7225 ts_manager.cc:194] Re-registered known tserver with Master: 9a4dc642e03b4bcca9b167edaad716e8 (127.29.190.130:44105)
I20260812 00:28:11.311033 7225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:48293
I20260812 00:28:11.311273 8927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.274885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35372 (local address 127.29.190.131:42863)
0812 00:28:11.287576 (+ 12691us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:11.287583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:11.287648 (+ 65us) server_negotiation.cc:407] Connection header received
0812 00:28:11.287719 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:11.287727 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:11.287973 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:11.288161 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:11.290382 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.293393 (+ 3011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.295881 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.296837 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.300705 (+ 3868us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:11.303337 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:11.303350 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:11.303366 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:11.303402 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:11.307748 (+ 4346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:11.308852 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:11.308861 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:11.308864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:11.309053 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:11.309590 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:11.309595 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:11.309599 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:11.310035 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:11.310338 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:11.310590 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 00:28:11.310857 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12499,"thread_start_us":12319,"threads_started":1}
I20260812 00:28:11.312644 7908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:11.406634 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 7724
I20260812 00:28:11.431010 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:42863
--local_ip_for_outbound_sockets=127.29.190.131
--tserver_master_addrs=127.29.190.190:36827
--webserver_port=44375
--webserver_interface=127.29.190.131
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab
--principal=oryx/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947,127.29.190.188:41217 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:28:11.625195 8693 heartbeater.cc:503] Master 127.29.190.190:36827 was elected leader, sending a full tablet report...
W20260812 00:28:11.798323 8930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:11.798645 8930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:11.798799 8930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:11.806650 8930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:11.806766 8930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:11.806946 8930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:11.817962 8930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab
--principal=oryx/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:42863
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=44375
--tserver_master_addrs=127.29.190.190:36827,127.29.190.189:35947,127.29.190.188:41217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:11.819403 8930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:11.820858 8930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:11.837189 8942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:11.837508 8943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:11.838553 8946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:11.839143 8930 server_base.cc:1034] running on GCE node
I20260812 00:28:11.840075 8930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:11.841388 8930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:11.844807 8930 hybrid_clock.cc:648] HybridClock initialized: now 1786494491844689 us; error 77 us; skew 500 ppm
I20260812 00:28:11.845266 8930 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:11 dist-test-slave-c12x krb5kdc[7156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494491, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:11.849455 8930 init.cc:377] Logged in from keytab as oryx/127.29.190.131@KRBTEST.COM (short username oryx)
I20260812 00:28:11.851173 8930 webserver.cc:460] Webserver started at http://127.29.190.131:44375/ using document root <none> and password file <none>
I20260812 00:28:11.852196 8930 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:11.852349 8930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:11.857995 8930 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 00:28:11.860994 8955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:11.862490 8930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:11.862637 8930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "d29d7ac26b514f978d5fc8994b44da30"
format_stamp: "Formatted at 2026-08-12 00:28:08 on dist-test-slave-c12x"
server_key: "f204c830c2589070d1e054b8f9fcc6de"
server_key_iv: "6cd129b1268c2eb4e626f673bd60f66c"
server_key_version: "encryptionkey@0"
I20260812 00:28:11.863889 8930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:11.906437 8930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:11.911813 8930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:11.912184 8930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:11.913491 8930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:11.915150 8930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:11.915299 8930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:11.915489 8930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:11.915598 8930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:11.957947 8930 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:42863
I20260812 00:28:11.958056 9116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:42863 every 8 connection(s)
I20260812 00:28:11.959738 8930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:11.961349 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 8930
Aug 12 00:28:12 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494491, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.188@KRBTEST.COM
Aug 12 00:28:12 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494491, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
Aug 12 00:28:12 dist-test-slave-c12x krb5kdc[7156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494491, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.189@KRBTEST.COM
I20260812 00:28:12.026294 9124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.963703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:41217 (local address 127.29.190.131:36077)
0812 00:28:11.973237 (+ 9534us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:11.973295 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:11.981239 (+ 7944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:11.984256 (+ 3017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:11.984277 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:11.985472 (+ 1195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:11.987135 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.987192 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.989877 (+ 2685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.989887 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:11.993439 (+ 3552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.993467 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.997219 (+ 3752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.997228 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:11.997712 (+ 484us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.002828 (+ 5116us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:12.002867 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:12.008786 (+ 5919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:12.015495 (+ 6709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:12.015506 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:12.015529 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:12.016322 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:12.021744 (+ 5422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:12.021751 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:12.021754 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:12.022095 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:12.022945 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:12.022957 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:12.023512 (+ 555us) client_negotiation.cc:769] Sending connection context
0812 00:28:12.023901 (+ 389us) client_negotiation.cc:240] Negotiation successful
0812 00:28:12.024587 (+ 686us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9151,"thread_start_us":8855,"threads_started":1}
I20260812 00:28:12.027779 9120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.962858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:36077 (local address 127.29.190.188:41217)
0812 00:28:11.983108 (+ 20250us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:11.983119 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:11.983148 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:28:11.983241 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:11.983250 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:11.983368 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:11.983541 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:11.987767 (+ 4226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.989527 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.993718 (+ 4191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.994768 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.994934 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.009087 (+ 14153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.009096 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.009140 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.009193 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.015273 (+ 6080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.021313 (+ 6040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.021325 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.021332 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.021579 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.022347 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.022355 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.022358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.022792 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.022979 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.026273 (+ 3294us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.026738 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20056,"thread_start_us":24644,"threads_started":1}
I20260812 00:28:12.030084 9127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.974215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:55107 (local address 127.29.190.190:36827)
0812 00:28:11.993262 (+ 19047us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:11.993272 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:11.993305 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:28:11.993407 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:11.993414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:11.993535 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:11.993709 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:11.997769 (+ 4060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.999088 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.001444 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.002255 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.002443 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.010144 (+ 7701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.010155 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.010163 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.010219 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.017958 (+ 7739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.021780 (+ 3822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.021786 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.021790 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.021980 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.022792 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.022799 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.022802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.025841 (+ 3039us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.026044 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.029069 (+ 3025us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.029703 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18822,"thread_start_us":19646,"threads_started":1}
I20260812 00:28:12.030131 9117 heartbeater.cc:347] Connected to a master server at 127.29.190.188:41217
I20260812 00:28:12.030540 9117 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:12.031728 9117 heartbeater.cc:511] Master 127.29.190.188:41217 requested a full tablet report, sending...
I20260812 00:28:12.033286 9126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.973997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.131:55107)
0812 00:28:11.977924 (+ 3927us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:11.977956 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:11.978218 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:11.993733 (+ 15515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:11.993739 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:11.996374 (+ 2635us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:11.996880 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:11.996901 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:11.999337 (+ 2436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:11.999349 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.001202 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.001218 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.004796 (+ 3578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.004805 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.004997 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.005748 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:12.005776 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:12.009796 (+ 4020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:12.018124 (+ 8328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:12.018129 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:12.018132 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:12.018794 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:12.022245 (+ 3451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:12.022253 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:12.022260 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:12.022472 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:12.027612 (+ 5140us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:12.027620 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:12.027842 (+ 222us) client_negotiation.cc:769] Sending connection context
0812 00:28:12.028079 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 00:28:12.028432 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3694,"thread_start_us":4716,"threads_started":1}
I20260812 00:28:12.033982 8417 ts_manager.cc:194] Registered new tserver with Master: d29d7ac26b514f978d5fc8994b44da30 (127.29.190.131:42863)
I20260812 00:28:12.035326 9118 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36827
I20260812 00:28:12.035815 9118 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:12.036450 9118 heartbeater.cc:511] Master 127.29.190.190:36827 requested a full tablet report, sending...
I20260812 00:28:12.037218 9131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.980488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.29.190.131:46217)
0812 00:28:11.997655 (+ 17167us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:11.997682 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:11.997839 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:11.999017 (+ 1178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:11.999024 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:11.999856 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:12.000267 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.000284 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.002127 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.002133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.004223 (+ 2090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.004249 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.008490 (+ 4241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.008511 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.008762 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.013594 (+ 4832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:12.013628 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:12.016876 (+ 3248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:12.030876 (+ 14000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:12.030882 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:12.030886 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:12.031586 (+ 700us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:12.032283 (+ 697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:12.032289 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:12.032292 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:12.032556 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:12.035968 (+ 3412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:12.035974 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:12.036213 (+ 239us) client_negotiation.cc:769] Sending connection context
0812 00:28:12.036410 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 00:28:12.036771 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17006,"thread_start_us":16767,"threads_started":1}
I20260812 00:28:12.037640 7225 ts_manager.cc:194] Re-registered known tserver with Master: d29d7ac26b514f978d5fc8994b44da30 (127.29.190.131:42863)
I20260812 00:28:12.038221 9129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.980515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:46217 (local address 127.29.190.189:35947)
0812 00:28:11.996039 (+ 15524us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:11.996050 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:11.998021 (+ 1971us) server_negotiation.cc:407] Connection header received
0812 00:28:11.998102 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:11.998109 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:11.998655 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:11.998780 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:12.000486 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.001677 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.004467 (+ 2790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.005266 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.005806 (+ 540us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.018287 (+ 12481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.018296 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.018301 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.018352 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.025311 (+ 6959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.031796 (+ 6485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.031866 (+ 70us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.031878 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.032113 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.032730 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.032736 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.032739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.034961 (+ 2222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.035177 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.037555 (+ 2378us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.037821 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15320,"thread_start_us":15124,"threads_started":1}
I20260812 00:28:12.038815 7225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:55107
I20260812 00:28:12.039188 9119 heartbeater.cc:347] Connected to a master server at 127.29.190.189:35947
I20260812 00:28:12.039345 9119 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:12.040048 9119 heartbeater.cc:511] Master 127.29.190.189:35947 requested a full tablet report, sending...
I20260812 00:28:12.041483 8122 ts_manager.cc:194] Registered new tserver with Master: d29d7ac26b514f978d5fc8994b44da30 (127.29.190.131:42863)
I20260812 00:28:12.043645 9147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.006583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52538 (local address 127.29.190.188:41217)
0812 00:28:12.008203 (+ 1620us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.008213 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.011715 (+ 3502us) server_negotiation.cc:407] Connection header received
0812 00:28:12.011923 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.011932 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.012063 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.012229 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:12.020085 (+ 7856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.021591 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.025417 (+ 3826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.026256 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.026369 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.033895 (+ 7526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.033902 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.033906 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.033948 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.040142 (+ 6194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.041034 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.041041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.041057 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.041248 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.041746 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.041751 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.041754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.042127 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.042294 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.042823 (+ 529us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.043050 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1041,"thread_start_us":928,"threads_started":1}
I20260812 00:28:12.048619 9143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.006267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60916 (local address 127.29.190.189:35947)
0812 00:28:12.022729 (+ 16462us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.022736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.022759 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:28:12.022824 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.022831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.022915 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.023043 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:12.026318 (+ 3275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.029988 (+ 3670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.032285 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.033129 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.033259 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.039716 (+ 6457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.039726 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.039732 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.039774 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.045277 (+ 5503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.045975 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.045979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.045981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.046146 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.046702 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.046708 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.046711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.047139 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.047369 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.047940 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.048190 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16310,"spinlock_wait_cycles":8960,"thread_start_us":16293,"threads_started":1}
I20260812 00:28:12.048636 9140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:11.998748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49028 (local address 127.29.190.190:36827)
0812 00:28:12.016649 (+ 17901us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.016658 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.016685 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:28:12.016754 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.016764 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.016850 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.016992 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:12.020176 (+ 3184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.021591 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.026882 (+ 5291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.027643 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.027777 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.033862 (+ 6085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.033871 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.033877 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.033919 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.042923 (+ 9004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.046048 (+ 3125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.046056 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.046059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.046237 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.046702 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.046708 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.046711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.047076 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.047345 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.047940 (+ 595us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.048190 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17741,"thread_start_us":18449,"threads_started":1}
I20260812 00:28:12.053483 7225 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:28:12.060696 7225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:28:12.099690 9164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.084618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:44105 (local address 127.0.0.1:45058)
0812 00:28:12.091241 (+ 6623us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:12.091254 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:12.091411 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:12.092574 (+ 1163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:12.092579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:12.092607 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:12.093028 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.093044 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.095203 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.095209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.097251 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.097264 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.098815 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.098822 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.099012 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.099051 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:28:12.099150 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 00:28:12.099288 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6524,"thread_start_us":5786,"threads_started":1}
I20260812 00:28:12.100059 9169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.085370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45058 (local address 127.29.190.130:44105)
0812 00:28:12.086097 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.086111 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.091398 (+ 5287us) server_negotiation.cc:407] Connection header received
0812 00:28:12.091634 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.091646 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.091959 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.092193 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:12.093269 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.094951 (+ 1682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.097407 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.098576 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.098765 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.098952 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.099242 (+ 290us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.099418 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":332,"threads_started":1}
I20260812 00:28:12.100883 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.084093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35374 (local address 127.29.190.131:42863)
0812 00:28:12.092033 (+ 7940us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.092042 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.092079 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:28:12.092489 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.092497 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.092751 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.093003 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:12.093734 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.095658 (+ 1924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.098253 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.099739 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.099934 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.100103 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.100503 (+ 400us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.100639 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7742,"thread_start_us":8091,"threads_started":1}
I20260812 00:28:12.100967 9162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.083767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:42863 (local address 127.0.0.1:35374)
0812 00:28:12.084514 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:12.084537 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:12.084673 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:12.093032 (+ 8359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:12.093040 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:12.093092 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:12.093548 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.093560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.095811 (+ 2251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.095816 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.098057 (+ 2241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.098072 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.100126 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.100132 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.100315 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.100349 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:28:12.100446 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 00:28:12.100591 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":38,"thread_start_us":416,"threads_started":1}
I20260812 00:28:12.105821 9029 tablet_service.cc:1467] Processing CreateTablet for tablet 70157251eefb4df896f610481ffc47ca (DEFAULT_TABLE table=test-table [id=e15887c65f6f401c872bda4989106422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:12.108860 9029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70157251eefb4df896f610481ffc47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:12.109573 8820 tablet_service.cc:1467] Processing CreateTablet for tablet 70157251eefb4df896f610481ffc47ca (DEFAULT_TABLE table=test-table [id=e15887c65f6f401c872bda4989106422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:12.111027 8820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70157251eefb4df896f610481ffc47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:12.119453 9166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.084534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49530)
0812 00:28:12.090688 (+ 6154us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:12.090706 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:12.090822 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:12.104082 (+ 13260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:12.104088 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:12.104130 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:12.104703 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.104721 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.107200 (+ 2479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.107211 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.109880 (+ 2669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.109901 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.118444 (+ 8543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.118455 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.118695 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.118739 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 00:28:12.118827 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:28:12.118996 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6020,"thread_start_us":6520,"threads_started":1}
I20260812 00:28:12.120718 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.084985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49530 (local address 127.29.190.129:34785)
0812 00:28:12.096341 (+ 11356us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.096352 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.096382 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:28:12.096486 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.096496 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.103726 (+ 7230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.105164 (+ 1438us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:12.105425 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.107028 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.115635 (+ 8607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.118087 (+ 2452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.119689 (+ 1602us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.120117 (+ 428us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.120200 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.120401 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8591,"thread_start_us":8468,"threads_started":1}
I20260812 00:28:12.125084 9173 tablet_bootstrap.cc:492] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Bootstrap starting.
I20260812 00:28:12.124862 8587 tablet_service.cc:1467] Processing CreateTablet for tablet 70157251eefb4df896f610481ffc47ca (DEFAULT_TABLE table=test-table [id=e15887c65f6f401c872bda4989106422]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:12.127272 8587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70157251eefb4df896f610481ffc47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:12.130101 9173 tablet_bootstrap.cc:654] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:12.131196 9173 log.cc:824] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:12.132661 9174 tablet_bootstrap.cc:492] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Bootstrap starting.
I20260812 00:28:12.134490 9173 tablet_bootstrap.cc:492] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: No bootstrap required, opened a new log
I20260812 00:28:12.134980 9173 ts_tablet_manager.cc:1397] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 00:28:12.139197 9174 tablet_bootstrap.cc:654] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:12.140733 9174 log.cc:824] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:12.143296 9178 tablet_bootstrap.cc:492] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Bootstrap starting.
I20260812 00:28:12.144392 9174 tablet_bootstrap.cc:492] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: No bootstrap required, opened a new log
I20260812 00:28:12.144771 9174 ts_tablet_manager.cc:1397] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260812 00:28:12.146200 9173 raft_consensus.cc:348] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.146960 9173 raft_consensus.cc:374] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:12.147066 9173 raft_consensus.cc:729] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d29d7ac26b514f978d5fc8994b44da30, State: Initialized, Role: FOLLOWER
I20260812 00:28:12.147886 9173 consensus_queue.cc:260] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.148279 9178 tablet_bootstrap.cc:654] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:12.150027 9178 log.cc:824] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:12.152392 9173 ts_tablet_manager.cc:1428] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260812 00:28:12.152824 9118 heartbeater.cc:503] Master 127.29.190.190:36827 was elected leader, sending a full tablet report...
I20260812 00:28:12.156169 9178 tablet_bootstrap.cc:492] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: No bootstrap required, opened a new log
I20260812 00:28:12.156504 9178 ts_tablet_manager.cc:1397] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260812 00:28:12.157027 9174 raft_consensus.cc:348] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.157513 9174 raft_consensus.cc:374] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:12.157657 9174 raft_consensus.cc:729] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a4dc642e03b4bcca9b167edaad716e8, State: Initialized, Role: FOLLOWER
I20260812 00:28:12.158351 9174 consensus_queue.cc:260] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.160281 9174 ts_tablet_manager.cc:1428] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
I20260812 00:28:12.160586 8916 heartbeater.cc:503] Master 127.29.190.190:36827 was elected leader, sending a full tablet report...
I20260812 00:28:12.167347 9178 raft_consensus.cc:348] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.167971 9178 raft_consensus.cc:374] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:12.168130 9178 raft_consensus.cc:729] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1715ce364f664f9eb906915c20b88dee, State: Initialized, Role: FOLLOWER
I20260812 00:28:12.168853 9178 consensus_queue.cc:260] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.170706 9178 ts_tablet_manager.cc:1428] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Time spent starting tablet: real 0.014s user 0.001s sys 0.011s
W20260812 00:28:12.241180 9134 tablet.cc:2369] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:28:12.268388 8918 tablet.cc:2369] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:28:12.330274 8695 tablet.cc:2369] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:28:12.351214 9182 raft_consensus.cc:482] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:28:12.351575 9182 raft_consensus.cc:504] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.353641 9182 leader_election.cc:288] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d29d7ac26b514f978d5fc8994b44da30 (127.29.190.131:42863), 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785)
I20260812 00:28:12.362210 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.354230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:35453 (local address 127.29.190.131:42863)
0812 00:28:12.354459 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.354468 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.355596 (+ 1128us) server_negotiation.cc:407] Connection header received
0812 00:28:12.356082 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.356088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.356173 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.356275 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:12.356962 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.357966 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.359979 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.361175 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.361355 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.361504 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.361802 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.361944 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:28:12.363008 9167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.354766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:40251 (local address 127.29.190.129:34785)
0812 00:28:12.354978 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.354986 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.355132 (+ 146us) server_negotiation.cc:407] Connection header received
0812 00:28:12.355533 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.355538 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.355640 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.355735 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:12.356610 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.357684 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.360485 (+ 2801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.361753 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.361940 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.362016 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.362603 (+ 587us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.362740 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 00:28:12.363188 9189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.354204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:42863 (local address 127.29.190.130:35453)
0812 00:28:12.355495 (+ 1291us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:12.355512 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:12.355780 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:12.356322 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:12.356327 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:12.356356 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:12.356747 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.356759 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.358109 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.358114 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.359804 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.359817 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.361408 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.361415 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.361596 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.361632 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:28:12.362446 (+ 814us) client_negotiation.cc:240] Negotiation successful
0812 00:28:12.362693 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1149,"mutex_wait_us":219,"thread_start_us":874,"threads_started":1}
I20260812 00:28:12.363313 9188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.354197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.29.190.130:40251)
0812 00:28:12.355003 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:12.355029 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:12.355287 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:12.355956 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:12.355959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:12.356008 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:12.356432 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.356446 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.357851 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.357857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.360249 (+ 2392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:12.360265 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.361982 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.361988 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:12.362200 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.362223 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 00:28:12.362339 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 00:28:12.362686 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":68,"thread_start_us":583,"threads_started":1}
I20260812 00:28:12.364460 9051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70157251eefb4df896f610481ffc47ca" candidate_uuid: "9a4dc642e03b4bcca9b167edaad716e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d29d7ac26b514f978d5fc8994b44da30" is_pre_election: true
I20260812 00:28:12.364466 8618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70157251eefb4df896f610481ffc47ca" candidate_uuid: "9a4dc642e03b4bcca9b167edaad716e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1715ce364f664f9eb906915c20b88dee" is_pre_election: true
I20260812 00:28:12.365111 9051 raft_consensus.cc:2454] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a4dc642e03b4bcca9b167edaad716e8 in term 0.
I20260812 00:28:12.365111 8618 raft_consensus.cc:2454] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a4dc642e03b4bcca9b167edaad716e8 in term 0.
I20260812 00:28:12.365859 8750 leader_election.cc:302] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1715ce364f664f9eb906915c20b88dee, 9a4dc642e03b4bcca9b167edaad716e8; no voters:
I20260812 00:28:12.366268 9182 raft_consensus.cc:2781] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:28:12.366441 9182 raft_consensus.cc:482] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:28:12.366569 9182 raft_consensus.cc:3037] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:12.369069 9182 raft_consensus.cc:504] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.369755 9182 leader_election.cc:288] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [CANDIDATE]: Term 1 election: Requested vote from peers d29d7ac26b514f978d5fc8994b44da30 (127.29.190.131:42863), 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785)
I20260812 00:28:12.370226 9051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70157251eefb4df896f610481ffc47ca" candidate_uuid: "9a4dc642e03b4bcca9b167edaad716e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d29d7ac26b514f978d5fc8994b44da30"
I20260812 00:28:12.370364 8618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70157251eefb4df896f610481ffc47ca" candidate_uuid: "9a4dc642e03b4bcca9b167edaad716e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1715ce364f664f9eb906915c20b88dee"
I20260812 00:28:12.370457 9051 raft_consensus.cc:3037] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:12.370630 8618 raft_consensus.cc:3037] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:12.372877 9051 raft_consensus.cc:2454] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a4dc642e03b4bcca9b167edaad716e8 in term 1.
I20260812 00:28:12.372982 8618 raft_consensus.cc:2454] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a4dc642e03b4bcca9b167edaad716e8 in term 1.
I20260812 00:28:12.373409 8749 leader_election.cc:302] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a4dc642e03b4bcca9b167edaad716e8, d29d7ac26b514f978d5fc8994b44da30; no voters:
I20260812 00:28:12.373780 9182 raft_consensus.cc:2781] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:12.374267 9182 raft_consensus.cc:686] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9a4dc642e03b4bcca9b167edaad716e8, State: Running, Role: LEADER
I20260812 00:28:12.374977 9182 consensus_queue.cc:237] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } }
I20260812 00:28:12.380084 7224 catalog_manager.cc:5495] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a4dc642e03b4bcca9b167edaad716e8 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "9a4dc642e03b4bcca9b167edaad716e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } health_report { overall_health: HEALTHY } } }
I20260812 00:28:12.410817 9169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.404450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45072 (local address 127.29.190.130:44105)
0812 00:28:12.404667 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.404673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.404786 (+ 113us) server_negotiation.cc:407] Connection header received
0812 00:28:12.404990 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.404994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.405104 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.405259 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:12.405720 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.406784 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.408611 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.409026 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.409161 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.409706 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:12.410268 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:12.410399 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.410514 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.410588 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:28:12.420301 9051 raft_consensus.cc:1261] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 1 FOLLOWER]: Refusing update from remote peer 9a4dc642e03b4bcca9b167edaad716e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:12.420301 8618 raft_consensus.cc:1261] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 1 FOLLOWER]: Refusing update from remote peer 9a4dc642e03b4bcca9b167edaad716e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:12.421931 9192 consensus_queue.cc:1035] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:12.422534 9182 consensus_queue.cc:1035] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:12.441689 9203 mvcc.cc:205] Tried to move back new op lower bound from 7317481440940683264 to 7317481440772014080. Current Snapshot: MvccSnapshot[applied={T|T < 7317481440940683264}]
I20260812 00:28:12.466655 7225 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:12.467015 7225 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:12.476817 7225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 909aa1c69f91424a848cd6df1ac9b4a8: Sending DeleteTablet for 3 replicas of tablet 70157251eefb4df896f610481ffc47ca
I20260812 00:28:12.478184 9029 tablet_service.cc:1514] Processing DeleteTablet for tablet 70157251eefb4df896f610481ffc47ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:12 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:35374
I20260812 00:28:12.478183 8587 tablet_service.cc:1514] Processing DeleteTablet for tablet 70157251eefb4df896f610481ffc47ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:12 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:49530
I20260812 00:28:12.478413 8820 tablet_service.cc:1514] Processing DeleteTablet for tablet 70157251eefb4df896f610481ffc47ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:12 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:45058
I20260812 00:28:12.494189 9217 tablet_replica.cc:330] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: stopping tablet replica
I20260812 00:28:12.494850 9217 raft_consensus.cc:2229] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:12.495815 9217 raft_consensus.cc:2258] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:12.497618 9219 tablet_replica.cc:330] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: stopping tablet replica
I20260812 00:28:12.498970 9219 raft_consensus.cc:2229] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:28:12.499886 9217 ts_tablet_manager.cc:1905] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:12.502663 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 7173
I20260812 00:28:12.502818 9219 raft_consensus.cc:2258] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:12.504061 7271 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:12.510107 9217 ts_tablet_manager.cc:1918] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:12.510244 9218 tablet_replica.cc:330] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: stopping tablet replica
I20260812 00:28:12.510367 9217 log.cc:1196] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/70157251eefb4df896f610481ffc47ca
I20260812 00:28:12.510684 9219 ts_tablet_manager.cc:1905] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:12.510756 9218 raft_consensus.cc:2229] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:12.511087 9217 ts_tablet_manager.cc:1939] T 70157251eefb4df896f610481ffc47ca P 1715ce364f664f9eb906915c20b88dee: Deleting consensus metadata
I20260812 00:28:12.511343 9218 raft_consensus.cc:2258] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:12.518040 9218 ts_tablet_manager.cc:1905] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:12.521139 9219 ts_tablet_manager.cc:1918] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:12.521350 9219 log.cc:1196] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/70157251eefb4df896f610481ffc47ca
I20260812 00:28:12.522073 9219 ts_tablet_manager.cc:1939] T 70157251eefb4df896f610481ffc47ca P 9a4dc642e03b4bcca9b167edaad716e8: Deleting consensus metadata
I20260812 00:28:12.530186 9143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.485309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60926 (local address 127.29.190.189:35947)
0812 00:28:12.485589 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.485598 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.500892 (+ 15294us) server_negotiation.cc:407] Connection header received
0812 00:28:12.503850 (+ 2958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.503859 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.503968 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.504060 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:12.511802 (+ 7742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.513260 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.515817 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.516528 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.516643 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.521826 (+ 5183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.521835 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.521840 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.521891 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.525867 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.526947 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.526953 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.526957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.527126 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.528016 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.528023 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.528027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.528455 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.528739 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.529526 (+ 787us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.529812 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:28:12.531747 9218 ts_tablet_manager.cc:1918] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:12.531970 9218 log.cc:1196] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/70157251eefb4df896f610481ffc47ca
I20260812 00:28:12.532662 9218 ts_tablet_manager.cc:1939] T 70157251eefb4df896f610481ffc47ca P d29d7ac26b514f978d5fc8994b44da30: Deleting consensus metadata
I20260812 00:28:12.554663 9147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.501545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52546 (local address 127.29.190.188:41217)
0812 00:28:12.501760 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.501766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.533294 (+ 31528us) server_negotiation.cc:407] Connection header received
0812 00:28:12.533569 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.533574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.533710 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.533797 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:12.536491 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.537676 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.539743 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.540397 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.540566 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.544855 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.544866 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.544872 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.544930 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.549523 (+ 4593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.550588 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.550596 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.550600 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.550813 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.551530 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.551537 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.551541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.551944 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.552208 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.553845 (+ 1637us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.554267 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:28:12.656672 7207 catalog_manager.cc:4841] TS 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785): tablet 70157251eefb4df896f610481ffc47ca (table test-table [id=e15887c65f6f401c872bda4989106422]) successfully deleted
W20260812 00:28:12.657124 7207 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.29.190.129:34785, user_credentials={real_user=slave}} blocked reactor thread for 143406us
I20260812 00:28:12.657860 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 7173
W20260812 00:28:12.690032 8750 connection.cc:535] server connection from 127.0.0.1:45058 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:28:12.719210 9143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.696003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60928 (local address 127.29.190.189:35947)
0812 00:28:12.696213 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.696221 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.697217 (+ 996us) server_negotiation.cc:407] Connection header received
0812 00:28:12.697513 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.697521 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.697625 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.697703 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:12.700226 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.704851 (+ 4625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.707060 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.707815 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.707931 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.712010 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.712019 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.712027 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.712078 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.716016 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.716892 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.716898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.716901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.717066 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.717552 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.717559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.717562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.717934 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.718232 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.718581 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.718822 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:28:12.723592 9147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:12.697399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52562 (local address 127.29.190.188:41217)
0812 00:28:12.697648 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:12.697657 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:12.708256 (+ 10599us) server_negotiation.cc:407] Connection header received
0812 00:28:12.708594 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:12.708600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:12.708693 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:12.708856 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:12.710822 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.711637 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.713598 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:12.714210 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:12.714344 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:12.717415 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:12.717427 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:12.717431 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:12.717465 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:12.720862 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.721547 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.721553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.721557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.721698 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:12.722084 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:12.722091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:12.722095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:12.722371 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:12.722665 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:12.722975 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 00:28:12.723215 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 00:28:13.455940 9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.454918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.131:39123)
0812 00:28:13.455504 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.455657 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":301,"threads_started":1}
W20260812 00:28:13.456396 9118 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:36827 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
I20260812 00:28:13.460948 9234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.460157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.129:33609)
0812 00:28:13.460662 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.460780 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":291,"threads_started":1}
W20260812 00:28:13.461377 8693 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:36827 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
I20260812 00:28:13.467263 9235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.466231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.130:41031)
0812 00:28:13.466868 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.467018 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":357,"threads_started":1}
W20260812 00:28:13.467748 8916 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:36827 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
I20260812 00:28:13.976166 9237 raft_consensus.cc:482] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 909aa1c69f91424a848cd6df1ac9b4a8)
I20260812 00:28:13.976632 9237 raft_consensus.cc:504] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } }
I20260812 00:28:13.976723 9238 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 909aa1c69f91424a848cd6df1ac9b4a8)
I20260812 00:28:13.977077 9238 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } }
I20260812 00:28:13.978282 9237 leader_election.cc:288] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 909aa1c69f91424a848cd6df1ac9b4a8 (127.29.190.190:36827), 3bb743aa935747e0b95dc4cd20207112 (127.29.190.189:35947)
I20260812 00:28:13.979897 9241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.978518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49478)
0812 00:28:13.979214 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.979490 (+ 276us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":300,"threads_started":1}
I20260812 00:28:13.981160 9238 leader_election.cc:288] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 909aa1c69f91424a848cd6df1ac9b4a8 (127.29.190.190:36827), c13cfb50f86844f08053b903f99ff236 (127.29.190.188:41217)
I20260812 00:28:13.981360 9240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.978489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49470)
0812 00:28:13.980637 (+ 2148us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.981032 (+ 395us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1950,"thread_start_us":1734,"threads_started":1}
W20260812 00:28:13.981693 8385 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
W20260812 00:28:13.982036 8100 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
I20260812 00:28:13.983960 9240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.983466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49488)
0812 00:28:13.983673 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.983777 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 00:28:13.985708 8385 leader_election.cc:334] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 909aa1c69f91424a848cd6df1ac9b4a8 (127.29.190.190:36827): Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
I20260812 00:28:13.985908 9250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.983899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49504)
0812 00:28:13.985341 (+ 1442us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.985610 (+ 269us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1317,"thread_start_us":1169,"threads_started":1}
W20260812 00:28:13.986096 8100 leader_election.cc:334] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 909aa1c69f91424a848cd6df1ac9b4a8 (127.29.190.190:36827): Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
I20260812 00:28:13.989472 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.978523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35947 (local address 127.0.0.1:60936)
0812 00:28:13.981111 (+ 2588us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.981138 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:13.981621 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:13.982583 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:13.982592 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:13.982631 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:13.983143 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:13.983167 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:13.984809 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:13.984820 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:13.987248 (+ 2428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:13.987265 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:13.988532 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:13.988538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:13.988722 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:13.988750 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:28:13.988881 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 00:28:13.989038 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2371,"thread_start_us":2157,"threads_started":1}
I20260812 00:28:13.989615 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.979178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60936 (local address 127.29.190.189:35947)
0812 00:28:13.981785 (+ 2607us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:13.981792 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:13.981816 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:28:13.981898 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:13.981904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:13.982089 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:13.982237 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:13.983465 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:13.984633 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:13.987457 (+ 2824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:13.988338 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:13.988523 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:13.988606 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:13.988912 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 00:28:13.989173 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":2465,"thread_start_us":2546,"threads_started":1}
I20260812 00:28:13.990290 8139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c13cfb50f86844f08053b903f99ff236" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3bb743aa935747e0b95dc4cd20207112" is_pre_election: true
I20260812 00:28:13.990690 8139 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c13cfb50f86844f08053b903f99ff236 in term 1.
I20260812 00:28:13.991297 8393 leader_election.cc:302] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb743aa935747e0b95dc4cd20207112, c13cfb50f86844f08053b903f99ff236; no voters: 909aa1c69f91424a848cd6df1ac9b4a8
I20260812 00:28:13.991910 9237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 00:28:13.992071 9237 raft_consensus.cc:482] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 909aa1c69f91424a848cd6df1ac9b4a8)
I20260812 00:28:13.992210 9237 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:28:13.992659 9241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.983538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:41217 (local address 127.0.0.1:52576)
0812 00:28:13.984220 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.984245 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:13.984398 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:13.986707 (+ 2309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:13.986712 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:13.986745 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:13.986986 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:13.986997 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:13.988650 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:13.988659 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:13.990340 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:13.990354 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:13.991719 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:13.991725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:13.991925 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:13.991950 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 00:28:13.992210 (+ 260us) client_negotiation.cc:240] Negotiation successful
0812 00:28:13.992363 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":19}
I20260812 00:28:13.992766 9246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.983679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52576 (local address 127.29.190.188:41217)
0812 00:28:13.986391 (+ 2712us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:13.986403 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:13.986430 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:28:13.986485 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:13.986489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:13.986547 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:13.986639 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:13.987248 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:13.988410 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:13.990512 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:13.991504 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:13.991726 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:13.991803 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:13.992267 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 00:28:13.992405 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2106,"thread_start_us":1830,"threads_started":1}
I20260812 00:28:13.993440 8435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3bb743aa935747e0b95dc4cd20207112" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c13cfb50f86844f08053b903f99ff236" is_pre_election: true
I20260812 00:28:13.995242 9237 raft_consensus.cc:504] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } }
I20260812 00:28:13.995769 8435 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bb743aa935747e0b95dc4cd20207112 in current term 2: Already voted for candidate c13cfb50f86844f08053b903f99ff236 in this term.
I20260812 00:28:13.996104 9237 leader_election.cc:288] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [CANDIDATE]: Term 2 election: Requested vote from peers 909aa1c69f91424a848cd6df1ac9b4a8 (127.29.190.190:36827), 3bb743aa935747e0b95dc4cd20207112 (127.29.190.189:35947)
I20260812 00:28:13.996737 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.996254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49514)
0812 00:28:13.996476 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.996589 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 00:28:13.996769 8139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c13cfb50f86844f08053b903f99ff236" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3bb743aa935747e0b95dc4cd20207112"
I20260812 00:28:13.997027 8139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:28:13.996937 8100 leader_election.cc:302] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb743aa935747e0b95dc4cd20207112; no voters: 909aa1c69f91424a848cd6df1ac9b4a8, c13cfb50f86844f08053b903f99ff236
I20260812 00:28:13.997975 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:13.997475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49524)
0812 00:28:13.997740 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:13.997852 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 00:28:13.998226 8385 leader_election.cc:334] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 909aa1c69f91424a848cd6df1ac9b4a8 (127.29.190.190:36827): Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
I20260812 00:28:13.999747 8139 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c13cfb50f86844f08053b903f99ff236 in term 2.
I20260812 00:28:13.999976 9238 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:28:14.000283 8393 leader_election.cc:302] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb743aa935747e0b95dc4cd20207112, c13cfb50f86844f08053b903f99ff236; no voters: 909aa1c69f91424a848cd6df1ac9b4a8
I20260812 00:28:14.000663 9237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:28:14.001204 9237 raft_consensus.cc:686] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [term 2 LEADER]: Becoming Leader. State: Replica: c13cfb50f86844f08053b903f99ff236, State: Running, Role: LEADER
I20260812 00:28:14.001643 9237 consensus_queue.cc:237] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } }
I20260812 00:28:14.003734 9253 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c13cfb50f86844f08053b903f99ff236. Latest consensus state: current_term: 2 leader_uuid: "c13cfb50f86844f08053b903f99ff236" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:14.004097 9253 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:14.004740 9255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:14.008389 9255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:14.009259 9255 catalog_manager.cc:1259] Loaded cluster ID: aa623a1f0b844db4bba89df78bfa3a50
I20260812 00:28:14.009363 9255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:14.010583 9255 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:14.011483 9255 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Loaded TSK: 0
I20260812 00:28:14.012377 9255 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:28:14.023937 8417 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52562:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:28:14.031658 8417 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:28:14.036590 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.036116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49544)
0812 00:28:14.036301 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.036444 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 00:28:14.036805 8139 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [term 2 FOLLOWER]: Refusing update from remote peer c13cfb50f86844f08053b903f99ff236: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 00:28:14.037814 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.037373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49548)
0812 00:28:14.037583 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.037664 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 00:28:14.037765 9253 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 00:28:14.038156 8385 consensus_peers.cc:487] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 -> Peer 909aa1c69f91424a848cd6df1ac9b4a8 (127.29.190.190:36827): Couldn't send request to peer 909aa1c69f91424a848cd6df1ac9b4a8. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:28:14.040962 9238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c13cfb50f86844f08053b903f99ff236. Latest consensus state: current_term: 2 leader_uuid: "c13cfb50f86844f08053b903f99ff236" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:14.041231 9238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:28:14.043051 9237 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c13cfb50f86844f08053b903f99ff236" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:14.043623 9237 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:14.044322 9238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c13cfb50f86844f08053b903f99ff236" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "909aa1c69f91424a848cd6df1ac9b4a8" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36827 } } peers { permanent_uuid: "3bb743aa935747e0b95dc4cd20207112" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35947 } attrs { promote: false } } peers { permanent_uuid: "c13cfb50f86844f08053b903f99ff236" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 41217 } attrs { promote: false } } }
I20260812 00:28:14.044641 9238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb743aa935747e0b95dc4cd20207112 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:28:14.047075 9258 mvcc.cc:205] Tried to move back new op lower bound from 7317481447565901824 to 7317481447434588160. Current Snapshot: MvccSnapshot[applied={T|T < 7317481447565901824 or (T in {7317481447565901824})}]
I20260812 00:28:14.069928 9269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.055602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35390 (local address 127.29.190.131:42863)
0812 00:28:14.056333 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.056343 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.060450 (+ 4107us) server_negotiation.cc:407] Connection header received
0812 00:28:14.060679 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.060688 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.060829 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.060981 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:14.061906 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.063750 (+ 1844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.066857 (+ 3107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.068614 (+ 1757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.068811 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.068900 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.069418 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.069585 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":381,"threads_started":1}
I20260812 00:28:14.069940 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.053930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:42863 (local address 127.0.0.1:35390)
0812 00:28:14.060279 (+ 6349us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.060307 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:14.060497 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:14.061032 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:14.061041 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:14.061081 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:14.061606 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.061654 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.063996 (+ 2342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.064001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.066212 (+ 2211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.066230 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.068895 (+ 2665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.068902 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.069202 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.069242 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:28:14.069359 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 00:28:14.069514 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6172,"thread_start_us":5903,"threads_started":1}
I20260812 00:28:14.071322 9029 tablet_service.cc:1467] Processing CreateTablet for tablet b3f5efc6b44543afbe3c7d55c1f5274c (DEFAULT_TABLE table=test-table [id=d7723a8b8b7b45e9b6c4b7d5c53124bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:14.071589 9240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.053383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:44105 (local address 127.0.0.1:45076)
0812 00:28:14.054450 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.054475 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:14.054618 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:14.064445 (+ 9827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:14.064450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:14.064482 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:14.064841 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.064856 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.066159 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.066165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.068873 (+ 2708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.068891 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.070785 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.070792 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.070988 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.071012 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 00:28:14.071124 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:28:14.071271 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"mutex_wait_us":1}
I20260812 00:28:14.071683 9266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.053457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45076 (local address 127.29.190.130:44105)
0812 00:28:14.063981 (+ 10524us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.063991 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.064019 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:28:14.064114 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.064123 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.064263 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.064387 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:14.065006 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.065987 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.069078 (+ 3091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.070360 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.070773 (+ 413us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.070853 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.071169 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.071321 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10338,"thread_start_us":10192,"threads_started":1}
I20260812 00:28:14.072070 9029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3f5efc6b44543afbe3c7d55c1f5274c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:14.072623 8820 tablet_service.cc:1467] Processing CreateTablet for tablet b3f5efc6b44543afbe3c7d55c1f5274c (DEFAULT_TABLE table=test-table [id=d7723a8b8b7b45e9b6c4b7d5c53124bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:14.072837 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.053246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49536)
0812 00:28:14.053556 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.053580 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:14.053722 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:14.065362 (+ 11640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:14.065367 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:14.065396 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:14.065640 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.065650 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.067499 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.067504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.069519 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.069533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.072048 (+ 2515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.072054 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.072284 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.072309 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 00:28:14.072425 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 00:28:14.072569 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":6}
I20260812 00:28:14.072937 9265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.053369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49536 (local address 127.29.190.129:34785)
0812 00:28:14.065027 (+ 11658us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.065034 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.065054 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:28:14.065127 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.065132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.065206 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.065312 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:14.065807 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.067323 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.069737 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.071122 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.072069 (+ 947us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.072161 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.072462 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.072627 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11537,"thread_start_us":11416,"threads_started":1}
I20260812 00:28:14.073107 8820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3f5efc6b44543afbe3c7d55c1f5274c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:14.073666 8587 tablet_service.cc:1467] Processing CreateTablet for tablet b3f5efc6b44543afbe3c7d55c1f5274c (DEFAULT_TABLE table=test-table [id=d7723a8b8b7b45e9b6c4b7d5c53124bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:14.074015 8587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3f5efc6b44543afbe3c7d55c1f5274c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:14.079742 9270 tablet_bootstrap.cc:492] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: Bootstrap starting.
I20260812 00:28:14.081869 9270 tablet_bootstrap.cc:654] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:14.084444 9270 tablet_bootstrap.cc:492] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: No bootstrap required, opened a new log
I20260812 00:28:14.084631 9270 ts_tablet_manager.cc:1397] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 00:28:14.085361 9270 raft_consensus.cc:348] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.085599 9270 raft_consensus.cc:374] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:14.085706 9270 raft_consensus.cc:729] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1715ce364f664f9eb906915c20b88dee, State: Initialized, Role: FOLLOWER
I20260812 00:28:14.086004 9270 consensus_queue.cc:260] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.086439 9273 tablet_bootstrap.cc:492] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: Bootstrap starting.
I20260812 00:28:14.088581 9273 tablet_bootstrap.cc:654] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:14.090040 9270 ts_tablet_manager.cc:1428] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260812 00:28:14.090962 9271 tablet_bootstrap.cc:492] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: Bootstrap starting.
I20260812 00:28:14.092938 9271 tablet_bootstrap.cc:654] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:14.096103 9271 tablet_bootstrap.cc:492] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: No bootstrap required, opened a new log
I20260812 00:28:14.096369 9271 ts_tablet_manager.cc:1397] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 00:28:14.096868 9280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.087396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.129:49379)
0812 00:28:14.096304 (+ 8908us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.096516 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8715,"thread_start_us":8507,"threads_started":1}
I20260812 00:28:14.097483 9271 raft_consensus.cc:348] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.097771 9271 raft_consensus.cc:374] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:14.097875 9271 raft_consensus.cc:729] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a4dc642e03b4bcca9b167edaad716e8, State: Initialized, Role: FOLLOWER
I20260812 00:28:14.097922 9273 tablet_bootstrap.cc:492] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: No bootstrap required, opened a new log
I20260812 00:28:14.098088 9273 ts_tablet_manager.cc:1397] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s
I20260812 00:28:14.098174 9271 consensus_queue.cc:260] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.099140 9273 raft_consensus.cc:348] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.099555 9273 raft_consensus.cc:374] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:14.099689 9273 raft_consensus.cc:729] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d29d7ac26b514f978d5fc8994b44da30, State: Initialized, Role: FOLLOWER
I20260812 00:28:14.100037 9273 consensus_queue.cc:260] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.101198 9273 ts_tablet_manager.cc:1428] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:14.105633 9271 ts_tablet_manager.cc:1428] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260812 00:28:14.112284 9117 heartbeater.cc:503] Master 127.29.190.188:41217 was elected leader, sending a full tablet report...
I20260812 00:28:14.112654 9290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.101981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.131:45417)
0812 00:28:14.112088 (+ 10107us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.112309 (+ 221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9928,"thread_start_us":9742,"threads_started":1}
I20260812 00:28:14.113719 8692 heartbeater.cc:503] Master 127.29.190.188:41217 was elected leader, sending a full tablet report...
I20260812 00:28:14.114341 9290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.113821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.131:50109)
0812 00:28:14.114083 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.114186 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260812 00:28:14.115921 9292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.105632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.130:53705)
0812 00:28:14.115394 (+ 9762us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.115629 (+ 235us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9646,"thread_start_us":9518,"threads_started":1}
I20260812 00:28:14.116109 9280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.115166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.129:35271)
0812 00:28:14.115323 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.115789 (+ 466us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 00:28:14.117910 9292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.117428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.130:50073)
0812 00:28:14.117676 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.117770 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260812 00:28:14.118089 8915 heartbeater.cc:503] Master 127.29.190.188:41217 was elected leader, sending a full tablet report...
I20260812 00:28:14.181711 9289 raft_consensus.cc:482] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:28:14.182013 9289 raft_consensus.cc:504] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.183912 9289 leader_election.cc:288] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a4dc642e03b4bcca9b167edaad716e8 (127.29.190.130:44105), 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785)
I20260812 00:28:14.189869 9266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.184282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:51901 (local address 127.29.190.130:44105)
0812 00:28:14.184489 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.184496 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.184635 (+ 139us) server_negotiation.cc:407] Connection header received
0812 00:28:14.184919 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.184924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.184990 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.185103 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:14.185599 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.186297 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.188060 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.188895 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.189098 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.189194 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.189463 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.189604 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:28:14.189911 9290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.184171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:44105 (local address 127.29.190.131:51901)
0812 00:28:14.184486 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.184507 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:14.184721 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:14.185127 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:14.185132 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:14.185160 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:14.185447 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.185456 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.186443 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.186449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.187904 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.187920 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.189096 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.189116 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.189288 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.189314 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:28:14.189423 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 00:28:14.189572 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260812 00:28:14.190629 9293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.184339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.29.190.131:54831)
0812 00:28:14.185124 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.185139 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:14.185309 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:14.185654 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:14.185659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:14.185682 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:14.185983 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.185992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.187178 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.187186 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.188629 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:14.188642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.189777 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.189784 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:14.189985 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.190025 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:28:14.190174 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 00:28:14.190305 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":511,"threads_started":1}
I20260812 00:28:14.190660 9265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.184469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:54831 (local address 127.29.190.129:34785)
0812 00:28:14.184718 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.184724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.185230 (+ 506us) server_negotiation.cc:407] Connection header received
0812 00:28:14.185464 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.185474 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.185538 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.185639 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:14.186141 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.186998 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.188795 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.189576 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.189770 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.189843 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.190223 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.190369 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:28:14.190920 8853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3f5efc6b44543afbe3c7d55c1f5274c" candidate_uuid: "d29d7ac26b514f978d5fc8994b44da30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a4dc642e03b4bcca9b167edaad716e8" is_pre_election: true
I20260812 00:28:14.191255 8618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3f5efc6b44543afbe3c7d55c1f5274c" candidate_uuid: "d29d7ac26b514f978d5fc8994b44da30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1715ce364f664f9eb906915c20b88dee" is_pre_election: true
I20260812 00:28:14.191408 8853 raft_consensus.cc:2454] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d29d7ac26b514f978d5fc8994b44da30 in term 0.
I20260812 00:28:14.191551 8618 raft_consensus.cc:2454] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d29d7ac26b514f978d5fc8994b44da30 in term 0.
I20260812 00:28:14.192157 8959 leader_election.cc:302] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1715ce364f664f9eb906915c20b88dee, d29d7ac26b514f978d5fc8994b44da30; no voters:
I20260812 00:28:14.192644 9289 raft_consensus.cc:2781] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:28:14.192793 9289 raft_consensus.cc:482] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:28:14.192891 9289 raft_consensus.cc:3037] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:14.195183 9289 raft_consensus.cc:504] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.195938 9289 leader_election.cc:288] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [CANDIDATE]: Term 1 election: Requested vote from peers 9a4dc642e03b4bcca9b167edaad716e8 (127.29.190.130:44105), 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785)
I20260812 00:28:14.196511 8853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3f5efc6b44543afbe3c7d55c1f5274c" candidate_uuid: "d29d7ac26b514f978d5fc8994b44da30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a4dc642e03b4bcca9b167edaad716e8"
I20260812 00:28:14.196740 8853 raft_consensus.cc:3037] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:14.196647 8618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3f5efc6b44543afbe3c7d55c1f5274c" candidate_uuid: "d29d7ac26b514f978d5fc8994b44da30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1715ce364f664f9eb906915c20b88dee"
I20260812 00:28:14.196936 8618 raft_consensus.cc:3037] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:14.199282 8853 raft_consensus.cc:2454] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d29d7ac26b514f978d5fc8994b44da30 in term 1.
I20260812 00:28:14.199290 8618 raft_consensus.cc:2454] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d29d7ac26b514f978d5fc8994b44da30 in term 1.
I20260812 00:28:14.199819 8957 leader_election.cc:302] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a4dc642e03b4bcca9b167edaad716e8, d29d7ac26b514f978d5fc8994b44da30; no voters:
I20260812 00:28:14.200214 9289 raft_consensus.cc:2781] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:14.200763 9289 raft_consensus.cc:686] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 1 LEADER]: Becoming Leader. State: Replica: d29d7ac26b514f978d5fc8994b44da30, State: Running, Role: LEADER
I20260812 00:28:14.201288 9289 consensus_queue.cc:237] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } }
I20260812 00:28:14.202085 9293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.201530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.131:42845)
0812 00:28:14.201808 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.201926 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 00:28:14.205567 8416 catalog_manager.cc:5495] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 reported cstate change: term changed from 0 to 1, leader changed from <none> to d29d7ac26b514f978d5fc8994b44da30 (127.29.190.131). New cstate: current_term: 1 leader_uuid: "d29d7ac26b514f978d5fc8994b44da30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d29d7ac26b514f978d5fc8994b44da30" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 } health_report { overall_health: UNKNOWN } } }
I20260812 00:28:14.236248 9269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.229784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35394 (local address 127.29.190.131:42863)
0812 00:28:14.230056 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.230061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.230108 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:28:14.230211 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.230215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.230300 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.230429 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:14.230922 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.231805 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.233440 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.233978 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.234108 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.234813 (+ 705us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:14.235520 (+ 707us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:14.235672 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.235817 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.235894 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260812 00:28:14.240749 8618 raft_consensus.cc:1261] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 1 FOLLOWER]: Refusing update from remote peer d29d7ac26b514f978d5fc8994b44da30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:14.241225 8853 raft_consensus.cc:1261] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 FOLLOWER]: Refusing update from remote peer d29d7ac26b514f978d5fc8994b44da30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:14.241766 9296 consensus_queue.cc:1035] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1715ce364f664f9eb906915c20b88dee" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:14.242249 9289 consensus_queue.cc:1035] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a4dc642e03b4bcca9b167edaad716e8" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:14.246057 9280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.245266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.129:46737)
0812 00:28:14.245636 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.245787 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207}
I20260812 00:28:14.246634 9292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.245885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.130:43161)
0812 00:28:14.246200 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.246360 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260812 00:28:14.252134 9303 mvcc.cc:205] Tried to move back new op lower bound from 7317481448402378752 to 7317481448253300736. Current Snapshot: MvccSnapshot[applied={T|T < 7317481448402378752}]
I20260812 00:28:14.255343 9293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.254739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.131:42843)
0812 00:28:14.254962 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.255107 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 00:28:14.258009 9292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.257421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.130:58431)
0812 00:28:14.257720 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.257821 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260812 00:28:14.266180 9293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.265524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.131:39923)
0812 00:28:14.265891 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.266001 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249}
I20260812 00:28:14.267091 9280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.266486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.29.190.129:40945)
0812 00:28:14.266732 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.266850 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260812 00:28:14.277550 9301 mvcc.cc:205] Tried to move back new op lower bound from 7317481448402378752 to 7317481448253300736. Current Snapshot: MvccSnapshot[applied={T|T < 7317481448402378752}]
I20260812 00:28:14.284961 8416 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:14.285260 8416 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:14.293355 8416 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c13cfb50f86844f08053b903f99ff236: Sending DeleteTablet for 3 replicas of tablet b3f5efc6b44543afbe3c7d55c1f5274c
I20260812 00:28:14.294384 8820 tablet_service.cc:1514] Processing DeleteTablet for tablet b3f5efc6b44543afbe3c7d55c1f5274c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:14 UTC) from {username='oryx', principal='oryx/127.29.190.188@KRBTEST.COM'} at 127.0.0.1:45076
I20260812 00:28:14.294673 8587 tablet_service.cc:1514] Processing DeleteTablet for tablet b3f5efc6b44543afbe3c7d55c1f5274c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:14 UTC) from {username='oryx', principal='oryx/127.29.190.188@KRBTEST.COM'} at 127.0.0.1:49536
I20260812 00:28:14.295281 9316 tablet_replica.cc:330] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: stopping tablet replica
I20260812 00:28:14.295305 9029 tablet_service.cc:1514] Processing DeleteTablet for tablet b3f5efc6b44543afbe3c7d55c1f5274c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:14 UTC) from {username='oryx', principal='oryx/127.29.190.188@KRBTEST.COM'} at 127.0.0.1:35390
I20260812 00:28:14.295691 9316 raft_consensus.cc:2229] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:14.296201 9316 raft_consensus.cc:2258] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:14.297837 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 8367
I20260812 00:28:14.301299 9316 ts_tablet_manager.cc:1905] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:14.309628 9316 ts_tablet_manager.cc:1918] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:14.309839 9316 log.cc:1196] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/b3f5efc6b44543afbe3c7d55c1f5274c
I20260812 00:28:14.310407 9316 ts_tablet_manager.cc:1939] T b3f5efc6b44543afbe3c7d55c1f5274c P 9a4dc642e03b4bcca9b167edaad716e8: Deleting consensus metadata
I20260812 00:28:14.310786 9318 tablet_replica.cc:330] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: stopping tablet replica
I20260812 00:28:14.311013 9318 raft_consensus.cc:2229] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:28:14.311782 9318 raft_consensus.cc:2258] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:14.311811 8386 catalog_manager.cc:4841] TS 9a4dc642e03b4bcca9b167edaad716e8 (127.29.190.130:44105): tablet b3f5efc6b44543afbe3c7d55c1f5274c (table test-table [id=d7723a8b8b7b45e9b6c4b7d5c53124bb]) successfully deleted
I20260812 00:28:14.313787 9317 tablet_replica.cc:330] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: stopping tablet replica
I20260812 00:28:14.313956 9317 raft_consensus.cc:2229] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:14.314205 9317 raft_consensus.cc:2258] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:14.315323 9317 ts_tablet_manager.cc:1905] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:14.320703 9265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.300070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.29.190.129:34785)
0812 00:28:14.300301 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.300309 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.300333 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:28:14.300411 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.300419 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.300522 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.300642 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:14.302874 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.304140 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.306147 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.306906 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.307021 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.312161 (+ 5140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:14.312186 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:14.312209 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:14.312267 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:14.316965 (+ 4698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:14.318002 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:14.318015 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:14.318022 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:14.318233 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:14.318747 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:14.318752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:14.318756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:14.319279 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:14.319649 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.320028 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.320283 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:28:14.321602 8685 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:14.321580 9317 ts_tablet_manager.cc:1918] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:14.321768 9317 log.cc:1196] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/b3f5efc6b44543afbe3c7d55c1f5274c
I20260812 00:28:14.324506 9318 ts_tablet_manager.cc:1905] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:14.332576 9318 ts_tablet_manager.cc:1918] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:14.332774 9318 log.cc:1196] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/b3f5efc6b44543afbe3c7d55c1f5274c
I20260812 00:28:14.333426 9318 ts_tablet_manager.cc:1939] T b3f5efc6b44543afbe3c7d55c1f5274c P d29d7ac26b514f978d5fc8994b44da30: Deleting consensus metadata
I20260812 00:28:14.334582 8386 catalog_manager.cc:4841] TS d29d7ac26b514f978d5fc8994b44da30 (127.29.190.131:42863): tablet b3f5efc6b44543afbe3c7d55c1f5274c (table test-table [id=d7723a8b8b7b45e9b6c4b7d5c53124bb]) successfully deleted
I20260812 00:28:14.449033 9317 ts_tablet_manager.cc:1939] T b3f5efc6b44543afbe3c7d55c1f5274c P 1715ce364f664f9eb906915c20b88dee: Deleting consensus metadata
I20260812 00:28:14.449294 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 8367
I20260812 00:28:14.479491 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 8712
I20260812 00:28:14.480119 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.479552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49552)
0812 00:28:14.479824 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.479899 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260812 00:28:14.480446 8391 catalog_manager.cc:4584] TS 1715ce364f664f9eb906915c20b88dee (127.29.190.129:34785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b3f5efc6b44543afbe3c7d55c1f5274c: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
I20260812 00:28:14.497776 9266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.480425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45084 (local address 127.29.190.130:44105)
0812 00:28:14.480705 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.480711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.480771 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:28:14.480988 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.480992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.481086 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.481173 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:14.483210 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.484244 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.486341 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.486866 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.486988 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.490652 (+ 3664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:14.490670 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:14.490688 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:14.490727 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:14.494205 (+ 3478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:14.495221 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:14.495230 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:14.495232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:14.495564 (+ 332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:14.496087 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:14.496090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:14.496093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:14.496524 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:14.496754 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.497224 (+ 470us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.497440 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260812 00:28:14.498808 8910 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:14.540535 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.539945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49564)
0812 00:28:14.540183 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.540314 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 00:28:14.541095 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.540638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49562)
0812 00:28:14.540799 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.540919 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 00:28:14.541978 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.541579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49578)
0812 00:28:14.541761 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.541832 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 00:28:14.542340 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.541819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49570)
0812 00:28:14.542069 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.542180 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
I20260812 00:28:14.611124 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.610514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49572)
0812 00:28:14.610775 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.610894 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260812 00:28:14.612440 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.611968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49576)
0812 00:28:14.612183 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.612289 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 00:28:14.638769 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 8712
I20260812 00:28:14.673048 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 8930
I20260812 00:28:14.691798 9269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.674048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35404 (local address 127.29.190.131:42863)
0812 00:28:14.674296 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:14.674301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:14.674325 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:28:14.674609 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:14.674614 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:14.674713 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:14.674816 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:14.676945 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.677811 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.679733 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:14.680197 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:14.680310 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:14.683945 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:14.683965 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:14.683984 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:14.684042 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:14.688175 (+ 4133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:14.689177 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:14.689185 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:14.689188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:14.689346 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:14.689866 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:14.689872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:14.689875 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:14.690278 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:14.690779 (+ 501us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:14.691101 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 00:28:14.691345 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 00:28:14.692613 9111 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:14.714309 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.713661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49588)
0812 00:28:14.713940 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.714078 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260812 00:28:14.715636 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.715100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49592)
0812 00:28:14.715278 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.715386 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 00:28:14.829838 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 8930
I20260812 00:28:14.863730 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 7924
I20260812 00:28:14.865120 8164 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:14.891367 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.887137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49606)
0812 00:28:14.891029 (+ 3892us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.891167 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3720}
I20260812 00:28:14.892709 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:14.892264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34785 (local address 127.0.0.1:49614)
0812 00:28:14.892470 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:14.892547 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:34785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260812 00:28:14.998262 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 7924
I20260812 00:28:15.003743 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:15.003250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49584)
0812 00:28:15.003493 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:15.003599 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:28:15.004820 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:15.004430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36827 (local address 127.0.0.1:49590)
0812 00:28:15.004601 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:15.004672 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 00:28:15.027704 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 8069
I20260812 00:28:15.029138 8459 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:15.161902 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 8069
2026-08-12T00:28:15Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10943 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:28:15 dist-test-slave-c12x krb5kdc[9334](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:28:15 dist-test-slave-c12x krb5kdc[9334](info): set up 2 sockets
Aug 12 00:28:15 dist-test-slave-c12x krb5kdc[9334](info): commencing operation
krb5kdc: starting...
W20260812 00:28:16.514847 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.004s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:28:16 dist-test-slave-c12x krb5kdc[9334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:28:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:16Z Disabled control of system clock
WARNING: no policy specified for oryx/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.190.keytab.
Entry for principal oryx/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.190.keytab.
I20260812 00:28:16.828085 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:39329
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.190.keytab
--principal=oryx/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:39329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:17.195986 9348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:17.196403 9348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:17.196576 9348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:17.204372 9348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:17.204530 9348 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 00:28:17.204635 9348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:17.204748 9348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:17.204835 9348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:17.204941 9348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:17.215564 9348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:39329
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.190.keytab
--principal=oryx/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:39329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:17.216993 9348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:17.218461 9348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:17.231882 9356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:17.231961 9355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:17.231961 9360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:17.232779 9348 server_base.cc:1034] running on GCE node
I20260812 00:28:17.233677 9348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:17.235208 9348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:17.236488 9348 hybrid_clock.cc:648] HybridClock initialized: now 1786494497236358 us; error 100 us; skew 500 ppm
I20260812 00:28:17.236881 9348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:17 dist-test-slave-c12x krb5kdc[9334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494497, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:17.245405 9348 init.cc:377] Logged in from keytab as oryx/127.29.190.190@KRBTEST.COM (short username oryx)
I20260812 00:28:17.247123 9348 webserver.cc:460] Webserver started at http://127.29.190.190:34579/ using document root <none> and password file <none>
I20260812 00:28:17.248014 9348 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:17.248174 9348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:17.248538 9348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:17.251969 9348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "c201304e3f774c84a9e01531e684d0b7"
format_stamp: "Formatted at 2026-08-12 00:28:17 on dist-test-slave-c12x"
server_key: "c875bf8a5be13772897d3cb4e6217388"
server_key_iv: "c4382667b2b18723cb6cd0f236af290e"
server_key_version: "encryptionkey@0"
I20260812 00:28:17.252887 9348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "c201304e3f774c84a9e01531e684d0b7"
format_stamp: "Formatted at 2026-08-12 00:28:17 on dist-test-slave-c12x"
server_key: "c875bf8a5be13772897d3cb4e6217388"
server_key_iv: "c4382667b2b18723cb6cd0f236af290e"
server_key_version: "encryptionkey@0"
I20260812 00:28:17.258656 9348 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260812 00:28:17.262900 9375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:17.264701 9348 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:28:17.264936 9348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "c201304e3f774c84a9e01531e684d0b7"
format_stamp: "Formatted at 2026-08-12 00:28:17 on dist-test-slave-c12x"
server_key: "c875bf8a5be13772897d3cb4e6217388"
server_key_iv: "c4382667b2b18723cb6cd0f236af290e"
server_key_version: "encryptionkey@0"
I20260812 00:28:17.265196 9348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:17.279814 9348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:17.284586 9348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:17.284909 9348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:17.310428 9348 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:39329
I20260812 00:28:17.310530 9456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:39329 every 8 connection(s)
I20260812 00:28:17.311949 9348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:28:17.316195 9457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:17.320955 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 9348
I20260812 00:28:17.321220 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:28:17.321892 30458 external_mini_cluster.cc:1428] Setting key e25f95a071cb1d58a357169ecc0b59a2
I20260812 00:28:17.329828 9457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: Bootstrap starting.
I20260812 00:28:17.334169 9457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:17.335829 9457 log.cc:824] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:28:17 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:17.339536 9457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: No bootstrap required, opened a new log
I20260812 00:28:17.348001 9457 raft_consensus.cc:348] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c201304e3f774c84a9e01531e684d0b7" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39329 } }
I20260812 00:28:17.348367 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:17.324109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43784 (local address 127.29.190.190:39329)
0812 00:28:17.325053 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:17.325066 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:17.325111 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:28:17.327086 (+ 1975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:17.327113 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:17.327674 (+ 561us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:17.328117 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:17.330520 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:17.332010 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:17.333897 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:17.334757 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:17.334909 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:17.340169 (+ 5260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:17.340178 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:17.340194 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:17.340242 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:17.343842 (+ 3600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:17.344638 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:17.344646 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:17.344653 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:17.344845 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:17.345289 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:17.345296 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:17.345299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:17.345915 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:17.346274 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:17.346746 (+ 472us) server_negotiation.cc:299] Negotiation successful
0812 00:28:17.347202 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":407,"threads_started":1}
I20260812 00:28:17.348450 9457 raft_consensus.cc:374] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:17.348593 9457 raft_consensus.cc:729] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201304e3f774c84a9e01531e684d0b7, State: Initialized, Role: FOLLOWER
I20260812 00:28:17.349239 9457 consensus_queue.cc:260] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c201304e3f774c84a9e01531e684d0b7" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39329 } }
I20260812 00:28:17.349526 9457 raft_consensus.cc:388] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:28:17.349699 9457 raft_consensus.cc:482] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:28:17.349925 9457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:17.352581 9457 raft_consensus.cc:504] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c201304e3f774c84a9e01531e684d0b7" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39329 } }
I20260812 00:28:17.353153 9457 leader_election.cc:302] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c201304e3f774c84a9e01531e684d0b7; no voters:
I20260812 00:28:17.353770 9457 leader_election.cc:288] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:28:17.353920 9465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:17.354812 9465 raft_consensus.cc:686] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [term 1 LEADER]: Becoming Leader. State: Replica: c201304e3f774c84a9e01531e684d0b7, State: Running, Role: LEADER
I20260812 00:28:17.355338 9465 consensus_queue.cc:237] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c201304e3f774c84a9e01531e684d0b7" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39329 } }
I20260812 00:28:17.356312 9457 sys_catalog.cc:564] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:17.358525 9470 sys_catalog.cc:455] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c201304e3f774c84a9e01531e684d0b7. Latest consensus state: current_term: 1 leader_uuid: "c201304e3f774c84a9e01531e684d0b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c201304e3f774c84a9e01531e684d0b7" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39329 } } }
I20260812 00:28:17.358618 9469 sys_catalog.cc:455] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c201304e3f774c84a9e01531e684d0b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c201304e3f774c84a9e01531e684d0b7" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39329 } } }
I20260812 00:28:17.358940 9470 sys_catalog.cc:458] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:17.359023 9469 sys_catalog.cc:458] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:17.364727 9477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:17.371232 9477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:17.380127 9477 catalog_manager.cc:1347] Generated new cluster ID: aa490d4f132a46388bda05a6e2f16e48
I20260812 00:28:17.380265 9477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:17.390029 9477 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:28:17.391548 9477 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:17.402737 9477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: Generated new TSK 0
I20260812 00:28:17.403731 9477 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab.
Entry for principal oryx/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab.
I20260812 00:28:17.467971 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39329
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab
--principal=oryx/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:17.852988 9497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:17.853303 9497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:17.853492 9497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:17.862190 9497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:17.862347 9497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:17.862507 9497 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:28:17.862653 9497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:17.873637 9497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab
--principal=oryx/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:39329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:17.875099 9497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:17.876631 9497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:17.891698 9504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:17.891678 9502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:17.891866 9506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:17.892554 9497 server_base.cc:1034] running on GCE node
I20260812 00:28:17.893266 9497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:17.894351 9497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:17.895617 9497 hybrid_clock.cc:648] HybridClock initialized: now 1786494497895535 us; error 37 us; skew 500 ppm
I20260812 00:28:17.896044 9497 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:17 dist-test-slave-c12x krb5kdc[9334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494497, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:17.899989 9497 init.cc:377] Logged in from keytab as oryx/127.29.190.129@KRBTEST.COM (short username oryx)
I20260812 00:28:17.901844 9497 webserver.cc:460] Webserver started at http://127.29.190.129:41513/ using document root <none> and password file <none>
I20260812 00:28:17.902665 9497 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:17.902837 9497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:17.903247 9497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:17.906418 9497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "06261aac331b4baead4e301edd5083bf"
format_stamp: "Formatted at 2026-08-12 00:28:17 on dist-test-slave-c12x"
server_key: "bdf997970c9458b9112a4eb4de2981ea"
server_key_iv: "119b4fb7ea06e6c9858d096e64952d14"
server_key_version: "encryptionkey@0"
I20260812 00:28:17.907241 9497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "06261aac331b4baead4e301edd5083bf"
format_stamp: "Formatted at 2026-08-12 00:28:17 on dist-test-slave-c12x"
server_key: "bdf997970c9458b9112a4eb4de2981ea"
server_key_iv: "119b4fb7ea06e6c9858d096e64952d14"
server_key_version: "encryptionkey@0"
I20260812 00:28:17.913686 9497 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:28:17.918365 9519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:17.920135 9497 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:28:17.920393 9497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "06261aac331b4baead4e301edd5083bf"
format_stamp: "Formatted at 2026-08-12 00:28:17 on dist-test-slave-c12x"
server_key: "bdf997970c9458b9112a4eb4de2981ea"
server_key_iv: "119b4fb7ea06e6c9858d096e64952d14"
server_key_version: "encryptionkey@0"
I20260812 00:28:17.920712 9497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:17.956890 9497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:17.962097 9497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:17.962404 9497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:17.966128 9497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:17.966245 9497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:17.966419 9497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:17.966511 9497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:28:17 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494497, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:17.997361 9531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:17.966904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:58611 (local address 127.29.190.190:39329)
0812 00:28:17.969790 (+ 2886us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:17.969799 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:17.969831 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:28:17.972361 (+ 2530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:17.972371 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:17.972625 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:17.972757 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:17.974985 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:17.976025 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:17.980116 (+ 4091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:17.980549 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:17.980670 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:17.987246 (+ 6576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:17.987260 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:17.987268 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:17.987338 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:17.992072 (+ 4734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:17.993646 (+ 1574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:17.993655 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:17.993661 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:17.993847 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:17.994604 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:17.994609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:17.994613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:17.995039 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:17.995227 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:17.996538 (+ 1311us) server_negotiation.cc:299] Negotiation successful
0812 00:28:17.996853 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2732,"thread_start_us":2569,"threads_started":1}
I20260812 00:28:17.999146 9534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:17.967719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39329 (local address 127.29.190.129:58611)
0812 00:28:17.969241 (+ 1522us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:17.969311 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:17.971932 (+ 2621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:17.973377 (+ 1445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:17.973403 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:17.974114 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:17.974766 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:17.974787 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:17.976285 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:17.976291 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:17.979883 (+ 3592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:17.979910 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:17.980879 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:17.980892 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:17.981334 (+ 442us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:17.982366 (+ 1032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:17.982412 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:17.986832 (+ 4420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:17.992301 (+ 5469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:17.992322 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:17.992348 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:17.993446 (+ 1098us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:17.994008 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:17.994015 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:17.994024 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:17.994420 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:17.995235 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:17.995247 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:17.995922 (+ 675us) client_negotiation.cc:769] Sending connection context
0812 00:28:17.996357 (+ 435us) client_negotiation.cc:240] Negotiation successful
0812 00:28:17.997131 (+ 774us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"thread_start_us":455,"threads_started":1}
I20260812 00:28:18.018019 9497 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:35479
I20260812 00:28:18.018132 9684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:35479 every 8 connection(s)
I20260812 00:28:18.019956 9497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:18.022553 9685 heartbeater.cc:347] Connected to a master server at 127.29.190.190:39329
I20260812 00:28:18.022876 9685 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:18.023734 9685 heartbeater.cc:511] Master 127.29.190.190:39329 requested a full tablet report, sending...
I20260812 00:28:18.026368 9398 ts_manager.cc:194] Registered new tserver with Master: 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479)
I20260812 00:28:18.027604 9660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:18.008606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39329 (local address 127.29.190.129:43949)
0812 00:28:18.010254 (+ 1648us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:18.010282 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:18.010453 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:18.010972 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:18.010983 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:18.011890 (+ 907us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:18.012578 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:18.012604 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.014641 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.014650 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:18.016446 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:18.016474 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.017875 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.017889 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:18.018130 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:18.018994 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:18.019014 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:18.020070 (+ 1056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:18.024202 (+ 4132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:18.024208 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:18.024213 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:18.024797 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:18.025380 (+ 583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:18.025384 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:18.025386 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:18.025588 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:18.026463 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:18.026470 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:18.026728 (+ 258us) client_negotiation.cc:769] Sending connection context
0812 00:28:18.026888 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 00:28:18.027180 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1410,"thread_start_us":807,"threads_started":1}
I20260812 00:28:18.027777 9531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:18.008418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:43949 (local address 127.29.190.190:39329)
0812 00:28:18.008674 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:18.008681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:18.010420 (+ 1739us) server_negotiation.cc:407] Connection header received
0812 00:28:18.010608 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:18.010617 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:18.010743 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:18.010889 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:18.012828 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.014418 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.016682 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.017576 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.017777 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:18.020354 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:18.020360 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:18.020363 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:18.020400 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:18.024026 (+ 3626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:18.024939 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:18.024945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:18.024948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:18.025195 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:18.025747 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:18.025752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:18.025755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:18.026186 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:18.026383 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:18.027072 (+ 689us) server_negotiation.cc:299] Negotiation successful
0812 00:28:18.027348 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260812 00:28:18.028530 9398 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:58611
I20260812 00:28:18.030572 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 9497
I20260812 00:28:18.030812 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:28:18.031773 30458 external_mini_cluster.cc:1428] Setting key 97d3bdbd26be72933b00649ef403abc0
WARNING: no policy specified for oryx/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab.
Entry for principal oryx/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab.
I20260812 00:28:18.096163 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39329
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab
--principal=oryx/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:18.467697 9693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:18.468006 9693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:18.468129 9693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:18.476025 9693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:18.476167 9693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:18.476255 9693 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:28:18.476339 9693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:18.486373 9693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab
--principal=oryx/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:39329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:18.487776 9693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:18.489149 9693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:18.505201 9706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:18.505399 9707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:18.505302 9709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:18.507081 9693 server_base.cc:1034] running on GCE node
I20260812 00:28:18.507892 9693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:18.509039 9693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:18.510327 9693 hybrid_clock.cc:648] HybridClock initialized: now 1786494498510260 us; error 33 us; skew 500 ppm
I20260812 00:28:18.510677 9693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:18 dist-test-slave-c12x krb5kdc[9334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494498, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:18.515084 9693 init.cc:377] Logged in from keytab as oryx/127.29.190.130@KRBTEST.COM (short username oryx)
I20260812 00:28:18.516876 9693 webserver.cc:460] Webserver started at http://127.29.190.130:42851/ using document root <none> and password file <none>
I20260812 00:28:18.517692 9693 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:18.517791 9693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:18.518201 9693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:18.521625 9693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726"
format_stamp: "Formatted at 2026-08-12 00:28:18 on dist-test-slave-c12x"
server_key: "260e3a824e43922b98a26de0aaebf1c3"
server_key_iv: "1220ec580c093520a619f25d0e870e3e"
server_key_version: "encryptionkey@0"
I20260812 00:28:18.522539 9693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726"
format_stamp: "Formatted at 2026-08-12 00:28:18 on dist-test-slave-c12x"
server_key: "260e3a824e43922b98a26de0aaebf1c3"
server_key_iv: "1220ec580c093520a619f25d0e870e3e"
server_key_version: "encryptionkey@0"
I20260812 00:28:18.528872 9693 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 00:28:18.532968 9718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:18.534693 9693 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:28:18.534889 9693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726"
format_stamp: "Formatted at 2026-08-12 00:28:18 on dist-test-slave-c12x"
server_key: "260e3a824e43922b98a26de0aaebf1c3"
server_key_iv: "1220ec580c093520a619f25d0e870e3e"
server_key_version: "encryptionkey@0"
I20260812 00:28:18.535141 9693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:18.553363 9693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:18.558917 9693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:18.559208 9693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:18.562450 9693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:18.562619 9693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:18.562810 9693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:18.562901 9693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:28:18 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494498, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:18.590925 9732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:18.564875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:45929 (local address 127.29.190.190:39329)
0812 00:28:18.565809 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:18.565815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:18.565838 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:28:18.568003 (+ 2165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:18.568009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:18.568106 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:18.568246 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:18.570771 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.571762 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.575667 (+ 3905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.576383 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.576553 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:18.582649 (+ 6096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:18.582655 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:18.582658 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:18.582699 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:18.586423 (+ 3724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:18.587714 (+ 1291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:18.587721 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:18.587723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:18.587908 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:18.588613 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:18.588621 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:18.588624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:18.589216 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:18.589414 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:18.590250 (+ 836us) server_negotiation.cc:299] Negotiation successful
0812 00:28:18.590526 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":798,"thread_start_us":961,"threads_started":1}
I20260812 00:28:18.592418 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:18.564257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39329 (local address 127.29.190.130:45929)
0812 00:28:18.565279 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:18.565332 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:18.567666 (+ 2334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:18.568537 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:18.568545 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:18.569534 (+ 989us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:18.570477 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:18.570499 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.571950 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.571956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:18.575423 (+ 3467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:18.575486 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.576711 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.576726 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:18.577115 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:18.578263 (+ 1148us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:18.578312 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:18.582298 (+ 3986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:18.586649 (+ 4351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:18.586664 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:18.586685 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:18.587500 (+ 815us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:18.588073 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:18.588084 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:18.588089 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:18.588421 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:18.589404 (+ 983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:18.589413 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:18.589837 (+ 424us) client_negotiation.cc:769] Sending connection context
0812 00:28:18.590139 (+ 302us) client_negotiation.cc:240] Negotiation successful
0812 00:28:18.590732 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":709,"threads_started":1}
I20260812 00:28:18.621112 9732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:18.604637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:36953 (local address 127.29.190.190:39329)
0812 00:28:18.604927 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:18.604938 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:18.605838 (+ 900us) server_negotiation.cc:407] Connection header received
0812 00:28:18.606192 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:18.606201 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:18.606295 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:18.606433 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:18.607785 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.609176 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.611620 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.612228 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.612389 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:18.614773 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:18.614779 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:18.614783 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:18.614821 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:18.617806 (+ 2985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:18.618670 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:18.618680 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:18.618687 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:18.618838 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:18.619374 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:18.619382 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:18.619387 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:18.619863 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:18.620095 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:18.620659 (+ 564us) server_negotiation.cc:299] Negotiation successful
0812 00:28:18.620873 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 00:28:18.621515 9822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:18.604645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39329 (local address 127.29.190.130:36953)
0812 00:28:18.605678 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:18.605707 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:18.605907 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:18.606469 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:18.606474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:18.607082 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:18.607562 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:18.607614 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.609361 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.609367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:18.611284 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:18.611304 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:18.612459 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:18.612466 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:18.612641 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:18.613565 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:18.613586 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:18.614475 (+ 889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:18.618001 (+ 3526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:18.618007 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:18.618012 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:18.618512 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:18.618986 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:18.618997 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:18.618999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:18.619173 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:18.620069 (+ 896us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:18.620078 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:18.620339 (+ 261us) client_negotiation.cc:769] Sending connection context
0812 00:28:18.620534 (+ 195us) client_negotiation.cc:240] Negotiation successful
0812 00:28:18.620945 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":658,"threads_started":1}
I20260812 00:28:18.634038 9693 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:35011
I20260812 00:28:18.634074 9887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:35011 every 8 connection(s)
I20260812 00:28:18.635511 9693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:18.636293 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 9693
I20260812 00:28:18.636541 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:28:18.637153 30458 external_mini_cluster.cc:1428] Setting key 0c2410a86469b801b28847ca80c1dbe9
I20260812 00:28:18.638270 9888 heartbeater.cc:347] Connected to a master server at 127.29.190.190:39329
I20260812 00:28:18.638545 9888 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:18.639416 9888 heartbeater.cc:511] Master 127.29.190.190:39329 requested a full tablet report, sending...
I20260812 00:28:18.641067 9398 ts_manager.cc:194] Registered new tserver with Master: b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130:35011)
I20260812 00:28:18.642001 9398 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:45929
WARNING: no policy specified for oryx/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab.
Entry for principal oryx/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab.
I20260812 00:28:18.699743 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39329
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab
--principal=oryx/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:28:19.032824 9685 heartbeater.cc:503] Master 127.29.190.190:39329 was elected leader, sending a full tablet report...
W20260812 00:28:19.061383 9893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:19.061676 9893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:19.061870 9893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:19.069216 9893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:19.069329 9893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:19.069492 9893 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 00:28:19.069614 9893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:19.079602 9893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab
--principal=oryx/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.190.190:39329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:19.081008 9893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:19.082502 9893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:19.096966 9899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:19.097056 9898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:19.097025 9902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:19.098889 9893 server_base.cc:1034] running on GCE node
I20260812 00:28:19.099784 9893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:19.100876 9893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:19.102212 9893 hybrid_clock.cc:648] HybridClock initialized: now 1786494499102121 us; error 54 us; skew 500 ppm
I20260812 00:28:19.102607 9893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:19 dist-test-slave-c12x krb5kdc[9334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494499, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:19.106278 9893 init.cc:377] Logged in from keytab as oryx/127.29.190.131@KRBTEST.COM (short username oryx)
I20260812 00:28:19.108043 9893 webserver.cc:460] Webserver started at http://127.29.190.131:36859/ using document root <none> and password file <none>
I20260812 00:28:19.108806 9893 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:19.108959 9893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:19.109338 9893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:19.112584 9893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "82585d277f7f4a839f645dfcb9d1999b"
format_stamp: "Formatted at 2026-08-12 00:28:19 on dist-test-slave-c12x"
server_key: "f31258c8e6ce954252ed895dea5f8504"
server_key_iv: "914838cbae58792af258701e784bda9a"
server_key_version: "encryptionkey@0"
I20260812 00:28:19.113474 9893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "82585d277f7f4a839f645dfcb9d1999b"
format_stamp: "Formatted at 2026-08-12 00:28:19 on dist-test-slave-c12x"
server_key: "f31258c8e6ce954252ed895dea5f8504"
server_key_iv: "914838cbae58792af258701e784bda9a"
server_key_version: "encryptionkey@0"
I20260812 00:28:19.119765 9893 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260812 00:28:19.124315 9910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:19.126308 9893 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260812 00:28:19.126606 9893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "82585d277f7f4a839f645dfcb9d1999b"
format_stamp: "Formatted at 2026-08-12 00:28:19 on dist-test-slave-c12x"
server_key: "f31258c8e6ce954252ed895dea5f8504"
server_key_iv: "914838cbae58792af258701e784bda9a"
server_key_version: "encryptionkey@0"
I20260812 00:28:19.126922 9893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:19.142318 9893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:19.147265 9893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:19.147614 9893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:19.150574 9893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:19.150663 9893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:19.150812 9893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:19.150880 9893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:28:19 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494499, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:19.181900 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.151843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:47147 (local address 127.29.190.190:39329)
0812 00:28:19.152398 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.152407 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.153766 (+ 1359us) server_negotiation.cc:407] Connection header received
0812 00:28:19.156779 (+ 3013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.156786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.156910 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.157074 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:19.160728 (+ 3654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.161943 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.165615 (+ 3672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.166469 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.166670 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.172358 (+ 5688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:19.172369 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:19.172376 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:19.172436 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:19.177134 (+ 4698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:19.178337 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:19.178342 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:19.178344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:19.178482 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:19.179123 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:19.179127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:19.179129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:19.179607 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:19.179788 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.180950 (+ 1162us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.181286 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":253,"threads_started":1}
I20260812 00:28:19.182696 9925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.152534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39329 (local address 127.29.190.131:47147)
0812 00:28:19.153551 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.153614 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.156314 (+ 2700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.157737 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.157753 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.158985 (+ 1232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:19.160425 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.160471 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.162156 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.162164 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.165285 (+ 3121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.165307 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.166806 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.166817 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.167065 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.168220 (+ 1155us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:19.168245 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:19.171947 (+ 3702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:19.177334 (+ 5387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:19.177348 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:19.177377 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:19.178125 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:19.178625 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:19.178632 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:19.178642 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:19.178984 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:19.179782 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:19.179791 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:19.180421 (+ 630us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.180788 (+ 367us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.181385 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":441,"threads_started":1}
I20260812 00:28:19.205626 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.189726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:36905 (local address 127.29.190.190:39329)
0812 00:28:19.189979 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.189989 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.190609 (+ 620us) server_negotiation.cc:407] Connection header received
0812 00:28:19.190789 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.190798 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.190927 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.191083 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:19.192479 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.193682 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.195400 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.195987 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.196152 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.199010 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:19.199019 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:19.199025 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:19.199083 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:19.202542 (+ 3459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:19.203573 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:19.203579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:19.203586 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:19.203729 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:19.204116 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:19.204121 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:19.204125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:19.204410 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:19.204577 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.204998 (+ 421us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.205248 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:28:19.205775 10046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.189742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39329 (local address 127.29.190.131:36905)
0812 00:28:19.190492 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.190519 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.190654 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.191107 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.191111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.191705 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:19.192277 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.192302 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.193841 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.193857 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.195138 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.195165 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.196248 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.196258 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.196539 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.197327 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:19.197359 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:19.198737 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:19.202696 (+ 3959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:19.202703 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:19.202707 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:19.203379 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:19.203849 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:19.203854 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:19.203857 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:19.203997 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:19.204544 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:19.204560 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:19.204747 (+ 187us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.204900 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.205270 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":404,"threads_started":1}
I20260812 00:28:19.210359 9893 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:36621
I20260812 00:28:19.210399 10088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:36621 every 8 connection(s)
I20260812 00:28:19.211715 9893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:19.213907 10089 heartbeater.cc:347] Connected to a master server at 127.29.190.190:39329
I20260812 00:28:19.214154 10089 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:19.214834 10089 heartbeater.cc:511] Master 127.29.190.190:39329 requested a full tablet report, sending...
I20260812 00:28:19.216348 9398 ts_manager.cc:194] Registered new tserver with Master: 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:19.217195 9398 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:47147
I20260812 00:28:19.219830 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 9893
I20260812 00:28:19.220048 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:28:19.220566 30458 external_mini_cluster.cc:1428] Setting key d93872e2cce4bf6878c7a377c075af2e
I20260812 00:28:19.223816 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 00:28:19 dist-test-slave-c12x krb5kdc[9334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494499, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 00:28:19 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:19 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:28:19.285653 9924 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:19.274172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43796 (local address 127.29.190.190:39329)
0812 00:28:19.274424 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.274432 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.274728 (+ 296us) server_negotiation.cc:407] Connection header received
0812 00:28:19.274984 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.274988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.275077 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.275197 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:19.276657 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.277393 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.278730 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.279158 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.279313 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.285253 (+ 5940us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43796: BlockingRecv error: recv got EOF from 127.0.0.1:43796 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 12 00:28:19 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494499, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:19.303418 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.289067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43804 (local address 127.29.190.190:39329)
0812 00:28:19.289323 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.289329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.289528 (+ 199us) server_negotiation.cc:407] Connection header received
0812 00:28:19.289671 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.289675 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.289740 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.289853 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:19.290951 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.291837 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.293173 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.293663 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.293771 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.297744 (+ 3973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:19.297749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:19.297753 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:19.297788 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:19.300654 (+ 2866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:19.301361 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:19.301367 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:19.301370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:19.301507 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:19.301963 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:19.301968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:19.301973 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:19.302261 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:19.302555 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.302864 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.303099 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 00:28:19.307807 9398 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:28:19.315758 9398 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:28:19.347219 10116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.329313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46242 (local address 127.29.190.129:35479)
0812 00:28:19.333518 (+ 4205us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.333531 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.333568 (+ 37us) server_negotiation.cc:407] Connection header received
0812 00:28:19.333699 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.333711 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.334185 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.335517 (+ 1332us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:19.337192 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.339498 (+ 2306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.344104 (+ 4606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.345770 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.345986 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.346223 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.346698 (+ 475us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.346878 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3977,"thread_start_us":2999,"threads_started":1}
I20260812 00:28:19.347251 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.329064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35479 (local address 127.0.0.1:46242)
0812 00:28:19.331203 (+ 2139us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.331243 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.331476 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.334520 (+ 3044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.334533 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.334577 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:19.335208 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.335226 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.339717 (+ 4491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.339727 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.343189 (+ 3462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.343219 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.346035 (+ 2816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.346042 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.346336 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.346410 (+ 74us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.346621 (+ 211us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.346883 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1859,"thread_start_us":14604,"threads_started":1}
I20260812 00:28:19.352313 9588 tablet_service.cc:1467] Processing CreateTablet for tablet e3f1f8df87c54000a14e1412d3721470 (DEFAULT_TABLE table=test-table [id=6ca5bc7cc0374b8fb6d44ca068ce1310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:19.353104 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.329380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:35011 (local address 127.0.0.1:34260)
0812 00:28:19.339774 (+ 10394us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.339802 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.339990 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.346329 (+ 6339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.346337 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.346368 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:19.346831 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.346844 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.348791 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.348797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.350910 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.350922 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.352420 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.352426 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.352602 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.352630 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.352684 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.352787 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10207,"thread_start_us":1386,"threads_started":1}
I20260812 00:28:19.353164 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.331625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:36621 (local address 127.0.0.1:53614)
0812 00:28:19.344007 (+ 12382us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.344028 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.344261 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.345374 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.345379 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.345407 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:19.345770 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.345783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.348035 (+ 2252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.348041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.350318 (+ 2277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.350335 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.352196 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.352204 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.352427 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.352464 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.352562 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.352710 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12241,"thread_start_us":7749,"threads_started":1}
I20260812 00:28:19.353181 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.332024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.29.190.131:36621)
0812 00:28:19.342221 (+ 10197us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.342235 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.344137 (+ 1902us) server_negotiation.cc:407] Connection header received
0812 00:28:19.344469 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.344478 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.344804 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.345001 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:19.346028 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.347844 (+ 1816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.350514 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.351976 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.352178 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.352363 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.352659 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.352832 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9984,"thread_start_us":9779,"threads_started":1}
I20260812 00:28:19.353976 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.329984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34260 (local address 127.29.190.130:35011)
0812 00:28:19.345680 (+ 15696us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.345687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.345711 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:28:19.345788 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.345793 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.346067 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.346337 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:19.347061 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.348617 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.351090 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.352179 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.353440 (+ 1261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.353600 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.353653 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.353778 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15520,"thread_start_us":15388,"threads_started":1}
I20260812 00:28:19.354562 9588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3f1f8df87c54000a14e1412d3721470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.357123 9984 tablet_service.cc:1467] Processing CreateTablet for tablet e3f1f8df87c54000a14e1412d3721470 (DEFAULT_TABLE table=test-table [id=6ca5bc7cc0374b8fb6d44ca068ce1310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:19.357565 9790 tablet_service.cc:1467] Processing CreateTablet for tablet e3f1f8df87c54000a14e1412d3721470 (DEFAULT_TABLE table=test-table [id=6ca5bc7cc0374b8fb6d44ca068ce1310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:19.358443 9984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3f1f8df87c54000a14e1412d3721470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.358891 9790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3f1f8df87c54000a14e1412d3721470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.371152 10124 tablet_bootstrap.cc:492] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Bootstrap starting.
I20260812 00:28:19.371376 10126 tablet_bootstrap.cc:492] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: Bootstrap starting.
I20260812 00:28:19.373997 10127 tablet_bootstrap.cc:492] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: Bootstrap starting.
I20260812 00:28:19.375032 10126 tablet_bootstrap.cc:654] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.376205 10126 log.cc:824] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:19.377687 10127 tablet_bootstrap.cc:654] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.378041 10124 tablet_bootstrap.cc:654] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.379011 10127 log.cc:824] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:19.379227 10124 log.cc:824] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:19.379285 10126 tablet_bootstrap.cc:492] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: No bootstrap required, opened a new log
I20260812 00:28:19.379882 10126 ts_tablet_manager.cc:1397] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260812 00:28:19.382942 10127 tablet_bootstrap.cc:492] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: No bootstrap required, opened a new log
I20260812 00:28:19.383479 10127 ts_tablet_manager.cc:1397] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20260812 00:28:19.387778 10124 tablet_bootstrap.cc:492] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: No bootstrap required, opened a new log
I20260812 00:28:19.388111 10124 ts_tablet_manager.cc:1397] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.004s
I20260812 00:28:19.389308 10126 raft_consensus.cc:348] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.389736 10126 raft_consensus.cc:374] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.389845 10126 raft_consensus.cc:729] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06261aac331b4baead4e301edd5083bf, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.390520 10126 consensus_queue.cc:260] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.392714 10126 ts_tablet_manager.cc:1428] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260812 00:28:19.394933 10127 raft_consensus.cc:348] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.395494 10127 raft_consensus.cc:374] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.395598 10127 raft_consensus.cc:729] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.396241 10127 consensus_queue.cc:260] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.398936 9888 heartbeater.cc:503] Master 127.29.190.190:39329 was elected leader, sending a full tablet report...
I20260812 00:28:19.399855 10124 raft_consensus.cc:348] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.400267 10127 ts_tablet_manager.cc:1428] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent starting tablet: real 0.017s user 0.004s sys 0.011s
I20260812 00:28:19.400388 10124 raft_consensus.cc:374] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.400646 10124 raft_consensus.cc:729] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82585d277f7f4a839f645dfcb9d1999b, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.401505 10124 consensus_queue.cc:260] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.402912 10089 heartbeater.cc:503] Master 127.29.190.190:39329 was elected leader, sending a full tablet report...
I20260812 00:28:19.403788 10124 ts_tablet_manager.cc:1428] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260812 00:28:19.404248 10132 raft_consensus.cc:482] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:28:19.404594 10132 raft_consensus.cc:504] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.406373 10132 leader_election.cc:288] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:19.414093 10116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.407222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:43189 (local address 127.29.190.129:35479)
0812 00:28:19.407463 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.407471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.407498 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:28:19.407736 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.407742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.407826 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.407893 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:19.409203 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.410002 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.412047 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.412996 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.413191 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.413268 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.413664 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.413823 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 00:28:19.414588 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.407541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:43865 (local address 127.29.190.131:36621)
0812 00:28:19.407735 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.407741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.408503 (+ 762us) server_negotiation.cc:407] Connection header received
0812 00:28:19.408615 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.408619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.408674 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.408750 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:19.409610 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.410395 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.412391 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.413452 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.413635 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.413703 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.414199 (+ 496us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.414346 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:28:19.414618 10138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.406781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:36621 (local address 127.29.190.130:43865)
0812 00:28:19.408372 (+ 1591us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.408389 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.408513 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.408802 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.408809 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.408840 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:19.409340 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.409350 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.410699 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.410707 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.412223 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.412237 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.413684 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.413690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.413902 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.413935 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.414048 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.414200 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1469,"mutex_wait_us":3,"thread_start_us":1259,"threads_started":1}
I20260812 00:28:19.415011 10135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.406637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35479 (local address 127.29.190.130:43189)
0812 00:28:19.407328 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.407353 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.407543 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.408509 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.408514 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.408536 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:19.408995 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.409013 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.410168 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.410175 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.411861 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.411874 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.413258 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.413265 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.413443 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.413479 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.414373 (+ 894us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.414520 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":22,"thread_start_us":1090,"threads_started":1}
I20260812 00:28:19.415886 10015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3f1f8df87c54000a14e1412d3721470" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82585d277f7f4a839f645dfcb9d1999b" is_pre_election: true
I20260812 00:28:19.416132 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3f1f8df87c54000a14e1412d3721470" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf" is_pre_election: true
I20260812 00:28:19.416570 10015 raft_consensus.cc:2454] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 0.
I20260812 00:28:19.416659 9613 raft_consensus.cc:2454] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 0.
I20260812 00:28:19.417418 9719 leader_election.cc:302] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82585d277f7f4a839f645dfcb9d1999b, b6c4fcb8303f49f2bf609b4ec2a4a726; no voters:
I20260812 00:28:19.418020 10132 raft_consensus.cc:2781] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:28:19.418200 10132 raft_consensus.cc:482] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:28:19.418334 10132 raft_consensus.cc:3037] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:19.420956 10132 raft_consensus.cc:504] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.421635 10132 leader_election.cc:288] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 election: Requested vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:19.422255 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3f1f8df87c54000a14e1412d3721470" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf"
I20260812 00:28:19.422253 10015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3f1f8df87c54000a14e1412d3721470" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82585d277f7f4a839f645dfcb9d1999b"
I20260812 00:28:19.422493 9613 raft_consensus.cc:3037] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:19.422493 10015 raft_consensus.cc:3037] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:19.426013 10015 raft_consensus.cc:2454] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 1.
I20260812 00:28:19.426033 9613 raft_consensus.cc:2454] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 1.
I20260812 00:28:19.426581 9719 leader_election.cc:302] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 06261aac331b4baead4e301edd5083bf, 82585d277f7f4a839f645dfcb9d1999b, b6c4fcb8303f49f2bf609b4ec2a4a726; no voters:
I20260812 00:28:19.427007 10132 raft_consensus.cc:2781] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:19.427852 10132 raft_consensus.cc:686] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 LEADER]: Becoming Leader. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Running, Role: LEADER
I20260812 00:28:19.428416 10132 consensus_queue.cc:237] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.434146 9398 catalog_manager.cc:5495] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } health_report { overall_health: UNKNOWN } } }
W20260812 00:28:19.463567 10090 tablet.cc:2369] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:28:19.473434 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.466919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34266 (local address 127.29.190.130:35011)
0812 00:28:19.467161 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.467169 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.467293 (+ 124us) server_negotiation.cc:407] Connection header received
0812 00:28:19.467688 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.467693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.467781 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.467971 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:19.468378 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.469387 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.470972 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.471428 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.471643 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.472152 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:19.472755 (+ 603us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:19.472932 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.473051 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.473142 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 00:28:19.482378 10015 raft_consensus.cc:1261] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Refusing update from remote peer b6c4fcb8303f49f2bf609b4ec2a4a726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:19.482424 9613 raft_consensus.cc:1261] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Refusing update from remote peer b6c4fcb8303f49f2bf609b4ec2a4a726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:19.483479 10141 consensus_queue.cc:1035] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:19.484055 10132 consensus_queue.cc:1035] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:19.512742 9397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:19.513087 9397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:19.517277 9397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: Sending DeleteTablet for 3 replicas of tablet e3f1f8df87c54000a14e1412d3721470
I20260812 00:28:19.518730 9588 tablet_service.cc:1514] Processing DeleteTablet for tablet e3f1f8df87c54000a14e1412d3721470 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:19 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:46242
I20260812 00:28:19.518826 9790 tablet_service.cc:1514] Processing DeleteTablet for tablet e3f1f8df87c54000a14e1412d3721470 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:19 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:34260
I20260812 00:28:19.519681 9984 tablet_service.cc:1514] Processing DeleteTablet for tablet e3f1f8df87c54000a14e1412d3721470 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:19 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:53614
I20260812 00:28:19.520587 9397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:28:19.521812 9397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:28:19.526134 10165 tablet_replica.cc:330] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: stopping tablet replica
I20260812 00:28:19.526782 10165 raft_consensus.cc:2229] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:19.527486 10165 raft_consensus.cc:2258] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:19.528182 10161 tablet_replica.cc:330] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: stopping tablet replica
I20260812 00:28:19.529276 10161 raft_consensus.cc:2229] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:28:19.530136 10161 raft_consensus.cc:2258] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:19.530884 10158 tablet_replica.cc:330] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: stopping tablet replica
I20260812 00:28:19.531397 10158 raft_consensus.cc:2229] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:19.534197 10158 raft_consensus.cc:2258] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:19.534540 10165 ts_tablet_manager.cc:1905] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:19.536885 9984 tablet_service.cc:1467] Processing CreateTablet for tablet 7a81a43b0a6145c19b715a0f75724c44 (DEFAULT_TABLE table=test-table [id=bda16e887d2248b78655d2bcb34d99ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:19.537451 9984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a81a43b0a6145c19b715a0f75724c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.539075 9790 tablet_service.cc:1467] Processing CreateTablet for tablet 7a81a43b0a6145c19b715a0f75724c44 (DEFAULT_TABLE table=test-table [id=bda16e887d2248b78655d2bcb34d99ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:19.540709 10158 ts_tablet_manager.cc:1905] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:19.543110 10165 ts_tablet_manager.cc:1918] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:19.543390 10165 log.cc:1196] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/e3f1f8df87c54000a14e1412d3721470
I20260812 00:28:19.544126 10165 ts_tablet_manager.cc:1939] T e3f1f8df87c54000a14e1412d3721470 P 82585d277f7f4a839f645dfcb9d1999b: Deleting consensus metadata
I20260812 00:28:19.545439 10124 tablet_bootstrap.cc:492] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: Bootstrap starting.
I20260812 00:28:19.546159 9376 catalog_manager.cc:4841] TS 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621): tablet e3f1f8df87c54000a14e1412d3721470 (table test-table [id=6ca5bc7cc0374b8fb6d44ca068ce1310]) successfully deleted
I20260812 00:28:19.546262 10161 ts_tablet_manager.cc:1905] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:19.546808 9790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a81a43b0a6145c19b715a0f75724c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.547106 10124 tablet_bootstrap.cc:654] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.554894 9588 tablet_service.cc:1467] Processing CreateTablet for tablet 7a81a43b0a6145c19b715a0f75724c44 (DEFAULT_TABLE table=test-table [id=bda16e887d2248b78655d2bcb34d99ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:19.555601 9588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a81a43b0a6145c19b715a0f75724c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.559213 10124 tablet_bootstrap.cc:492] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: No bootstrap required, opened a new log
I20260812 00:28:19.559538 10124 ts_tablet_manager.cc:1397] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20260812 00:28:19.560535 10124 raft_consensus.cc:348] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.560916 10124 raft_consensus.cc:374] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.561077 10124 raft_consensus.cc:729] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82585d277f7f4a839f645dfcb9d1999b, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.561474 10124 consensus_queue.cc:260] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.563038 10124 ts_tablet_manager.cc:1428] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:19.563475 10158 ts_tablet_manager.cc:1918] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:19.563730 10158 log.cc:1196] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/e3f1f8df87c54000a14e1412d3721470
I20260812 00:28:19.564129 10161 ts_tablet_manager.cc:1918] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:19.564412 10161 log.cc:1196] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/e3f1f8df87c54000a14e1412d3721470
I20260812 00:28:19.564476 10158 ts_tablet_manager.cc:1939] T e3f1f8df87c54000a14e1412d3721470 P 06261aac331b4baead4e301edd5083bf: Deleting consensus metadata
I20260812 00:28:19.565379 10161 ts_tablet_manager.cc:1939] T e3f1f8df87c54000a14e1412d3721470 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting consensus metadata
I20260812 00:28:19.565424 10127 tablet_bootstrap.cc:492] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: Bootstrap starting.
I20260812 00:28:19.567024 10126 tablet_bootstrap.cc:492] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: Bootstrap starting.
I20260812 00:28:19.567657 10127 tablet_bootstrap.cc:654] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.568814 10126 tablet_bootstrap.cc:654] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.570109 9376 catalog_manager.cc:4841] TS b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130:35011): tablet e3f1f8df87c54000a14e1412d3721470 (table test-table [id=6ca5bc7cc0374b8fb6d44ca068ce1310]) successfully deleted
I20260812 00:28:19.570490 9382 catalog_manager.cc:4841] TS 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479): tablet e3f1f8df87c54000a14e1412d3721470 (table test-table [id=6ca5bc7cc0374b8fb6d44ca068ce1310]) successfully deleted
I20260812 00:28:19.573772 10126 tablet_bootstrap.cc:492] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: No bootstrap required, opened a new log
I20260812 00:28:19.573972 10126 ts_tablet_manager.cc:1397] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260812 00:28:19.573989 10127 tablet_bootstrap.cc:492] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: No bootstrap required, opened a new log
I20260812 00:28:19.574152 10127 ts_tablet_manager.cc:1397] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260812 00:28:19.574728 10126 raft_consensus.cc:348] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.574945 10126 raft_consensus.cc:374] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.575048 10126 raft_consensus.cc:729] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06261aac331b4baead4e301edd5083bf, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.575062 10127 raft_consensus.cc:348] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.575359 10127 raft_consensus.cc:374] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.575515 10127 raft_consensus.cc:729] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.575357 10126 consensus_queue.cc:260] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.575804 10127 consensus_queue.cc:260] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.576349 10126 ts_tablet_manager.cc:1428] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:28:19.576586 10127 ts_tablet_manager.cc:1428] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260812 00:28:19.638072 9890 tablet.cc:2369] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:28:19.775060 9687 tablet.cc:2369] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:28:19.831202 10133 raft_consensus.cc:482] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:28:19.831499 10133 raft_consensus.cc:504] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.833519 10133 leader_election.cc:288] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130:35011)
I20260812 00:28:19.842183 10116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.834130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:34697 (local address 127.29.190.129:35479)
0812 00:28:19.834341 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.834349 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.835032 (+ 683us) server_negotiation.cc:407] Connection header received
0812 00:28:19.835371 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.835377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.835498 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.835588 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:19.836306 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.837424 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.839884 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.841093 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.841284 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.841369 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.841711 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.841871 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:28:19.842250 10170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.833865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35479 (local address 127.29.190.131:34697)
0812 00:28:19.834879 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.834930 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.835173 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.835808 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.835813 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.835839 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:19.836085 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.836098 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.837597 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.837604 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.839644 (+ 2040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.839659 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.841305 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.841311 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.841496 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.841534 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.841661 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.841825 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"mutex_wait_us":3,"thread_start_us":597,"threads_started":1}
I20260812 00:28:19.843331 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.834196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:53845 (local address 127.29.190.130:35011)
0812 00:28:19.834449 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.834456 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.835272 (+ 816us) server_negotiation.cc:407] Connection header received
0812 00:28:19.835665 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.835671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.835784 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.835859 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:19.836755 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.837872 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.840553 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.842005 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.842175 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.842270 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.842854 (+ 584us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.843005 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 00:28:19.843365 10171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.833865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:35011 (local address 127.29.190.131:53845)
0812 00:28:19.835148 (+ 1283us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.835168 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.835396 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.836109 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.836113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.836145 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:19.836521 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.836536 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.838039 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.838044 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.840345 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.840361 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.842468 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.842479 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.842674 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.842700 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.842818 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.842976 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1162,"mutex_wait_us":669,"thread_start_us":318,"threads_started":1}
I20260812 00:28:19.843472 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a81a43b0a6145c19b715a0f75724c44" candidate_uuid: "82585d277f7f4a839f645dfcb9d1999b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf" is_pre_election: true
I20260812 00:28:19.843781 9613 raft_consensus.cc:2454] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82585d277f7f4a839f645dfcb9d1999b in term 0.
I20260812 00:28:19.844378 9914 leader_election.cc:302] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06261aac331b4baead4e301edd5083bf, 82585d277f7f4a839f645dfcb9d1999b; no voters:
I20260812 00:28:19.844879 10133 raft_consensus.cc:2781] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:28:19.844655 9827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a81a43b0a6145c19b715a0f75724c44" candidate_uuid: "82585d277f7f4a839f645dfcb9d1999b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" is_pre_election: true
I20260812 00:28:19.845031 10133 raft_consensus.cc:482] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:28:19.845155 10133 raft_consensus.cc:3037] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:19.845278 9827 raft_consensus.cc:2454] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82585d277f7f4a839f645dfcb9d1999b in term 0.
I20260812 00:28:19.848048 10133 raft_consensus.cc:504] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.848708 10133 leader_election.cc:288] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [CANDIDATE]: Term 1 election: Requested vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130:35011)
I20260812 00:28:19.849349 9827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a81a43b0a6145c19b715a0f75724c44" candidate_uuid: "82585d277f7f4a839f645dfcb9d1999b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726"
I20260812 00:28:19.849334 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a81a43b0a6145c19b715a0f75724c44" candidate_uuid: "82585d277f7f4a839f645dfcb9d1999b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf"
I20260812 00:28:19.849591 9827 raft_consensus.cc:3037] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:19.849610 9613 raft_consensus.cc:3037] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:19.852011 9613 raft_consensus.cc:2454] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82585d277f7f4a839f645dfcb9d1999b in term 1.
I20260812 00:28:19.852483 9914 leader_election.cc:302] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06261aac331b4baead4e301edd5083bf, 82585d277f7f4a839f645dfcb9d1999b; no voters:
I20260812 00:28:19.852833 10133 raft_consensus.cc:2781] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:19.853171 9827 raft_consensus.cc:2454] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82585d277f7f4a839f645dfcb9d1999b in term 1.
I20260812 00:28:19.853380 10133 raft_consensus.cc:686] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 1 LEADER]: Becoming Leader. State: Replica: 82585d277f7f4a839f645dfcb9d1999b, State: Running, Role: LEADER
I20260812 00:28:19.854295 10133 consensus_queue.cc:237] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.858325 9398 catalog_manager.cc:5495] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b reported cstate change: term changed from 0 to 1, leader changed from <none> to 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131). New cstate: current_term: 1 leader_uuid: "82585d277f7f4a839f645dfcb9d1999b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } health_report { overall_health: HEALTHY } } }
Aug 12 00:28:19 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494497, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.190@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:19.948954 10182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.934217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43812 (local address 127.29.190.190:39329)
0812 00:28:19.935366 (+ 1149us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:19.935370 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:19.935386 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:28:19.935478 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:19.935483 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:19.935559 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:19.935679 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:19.936835 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.937647 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.938934 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.939356 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.939524 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.943234 (+ 3710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:19.943239 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:19.943243 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:19.943273 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:19.945946 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:19.946730 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:19.946737 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:19.946741 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:19.946869 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:19.947269 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:19.947274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:19.947277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:19.947642 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:19.947796 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:19.948222 (+ 426us) server_negotiation.cc:299] Negotiation successful
0812 00:28:19.948533 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":1057,"thread_start_us":900,"threads_started":1}
I20260812 00:28:19.949048 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:19.934158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39329 (local address 127.0.0.1:43812)
0812 00:28:19.934900 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:19.934924 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:19.935095 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:19.935716 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:19.935722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:19.936456 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:19.936681 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.936692 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.937779 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.937787 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.938738 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:19.938750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:19.939555 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:19.939560 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:19.939758 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:19.940545 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:19.940564 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:19.942999 (+ 2435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:19.946101 (+ 3102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:19.946115 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:19.946123 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:19.946604 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:19.946990 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:19.946995 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:19.946999 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:19.947150 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:19.947782 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:19.947789 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:19.947961 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:28:19.948144 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 00:28:19.948645 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"mutex_wait_us":186,"thread_start_us":399,"threads_started":1}
I20260812 00:28:19.955230 9398 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:43812:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 00:28:19.956645 9398 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:28:19.964182 9588 tablet_service.cc:1467] Processing CreateTablet for tablet 03f834d91dee4b2b852f206c40f2d2b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f8589aa975564c93aee477ba4e73340e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:28:19.964479 9790 tablet_service.cc:1467] Processing CreateTablet for tablet 03f834d91dee4b2b852f206c40f2d2b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f8589aa975564c93aee477ba4e73340e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:28:19.964823 9588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f834d91dee4b2b852f206c40f2d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.965196 9790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f834d91dee4b2b852f206c40f2d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.968339 9984 tablet_service.cc:1467] Processing CreateTablet for tablet 03f834d91dee4b2b852f206c40f2d2b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f8589aa975564c93aee477ba4e73340e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 00:28:19.968881 9984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f834d91dee4b2b852f206c40f2d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:19.972450 10127 tablet_bootstrap.cc:492] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: Bootstrap starting.
I20260812 00:28:19.974316 10127 tablet_bootstrap.cc:654] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.974702 10126 tablet_bootstrap.cc:492] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: Bootstrap starting.
I20260812 00:28:19.976543 10126 tablet_bootstrap.cc:654] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.976919 10127 tablet_bootstrap.cc:492] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: No bootstrap required, opened a new log
I20260812 00:28:19.976979 10124 tablet_bootstrap.cc:492] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: Bootstrap starting.
I20260812 00:28:19.977229 10127 ts_tablet_manager.cc:1397] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260812 00:28:19.977957 10127 raft_consensus.cc:348] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.978209 10127 raft_consensus.cc:374] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.978302 10127 raft_consensus.cc:729] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.978572 10127 consensus_queue.cc:260] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.978816 10124 tablet_bootstrap.cc:654] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:19.978976 10126 tablet_bootstrap.cc:492] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: No bootstrap required, opened a new log
I20260812 00:28:19.979143 10126 ts_tablet_manager.cc:1397] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 00:28:19.979051 10141 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:19.979346 10141 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:28:19.979918 10126 raft_consensus.cc:348] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.980466 10126 raft_consensus.cc:374] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.980528 10127 ts_tablet_manager.cc:1428] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:19.980626 10126 raft_consensus.cc:729] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06261aac331b4baead4e301edd5083bf, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.981019 10126 consensus_queue.cc:260] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.981541 10131 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:19.981930 10131 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:28:19.982183 10124 tablet_bootstrap.cc:492] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: No bootstrap required, opened a new log
I20260812 00:28:19.982373 10124 ts_tablet_manager.cc:1397] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 00:28:19.982936 10126 ts_tablet_manager.cc:1428] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 00:28:19.983163 10124 raft_consensus.cc:348] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.983449 10124 raft_consensus.cc:374] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:19.983587 10124 raft_consensus.cc:729] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82585d277f7f4a839f645dfcb9d1999b, State: Initialized, Role: FOLLOWER
I20260812 00:28:19.983865 10124 consensus_queue.cc:260] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:19.984407 10124 ts_tablet_manager.cc:1428] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 00:28:19.984280 10133 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:19.985132 10133 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:28:20.099161 10141 raft_consensus.cc:482] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:28:20.099414 10141 raft_consensus.cc:504] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.100216 10141 leader_election.cc:288] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:20.100793 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f834d91dee4b2b852f206c40f2d2b5" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf" is_pre_election: true
I20260812 00:28:20.100826 10015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f834d91dee4b2b852f206c40f2d2b5" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82585d277f7f4a839f645dfcb9d1999b" is_pre_election: true
I20260812 00:28:20.101078 9613 raft_consensus.cc:2454] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 0.
I20260812 00:28:20.101076 10015 raft_consensus.cc:2454] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 0.
I20260812 00:28:20.101586 9725 leader_election.cc:302] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 06261aac331b4baead4e301edd5083bf, 82585d277f7f4a839f645dfcb9d1999b, b6c4fcb8303f49f2bf609b4ec2a4a726; no voters:
I20260812 00:28:20.101930 10141 raft_consensus.cc:2781] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:28:20.102023 10141 raft_consensus.cc:482] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:28:20.102164 10141 raft_consensus.cc:3037] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:20.104481 10141 raft_consensus.cc:504] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.105221 10141 leader_election.cc:288] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 election: Requested vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:20.105899 10015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f834d91dee4b2b852f206c40f2d2b5" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82585d277f7f4a839f645dfcb9d1999b"
I20260812 00:28:20.105880 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f834d91dee4b2b852f206c40f2d2b5" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf"
I20260812 00:28:20.106142 10015 raft_consensus.cc:3037] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:20.106158 9613 raft_consensus.cc:3037] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:20.109151 9613 raft_consensus.cc:2454] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 1.
I20260812 00:28:20.109180 10015 raft_consensus.cc:2454] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 1.
I20260812 00:28:20.109808 9719 leader_election.cc:302] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82585d277f7f4a839f645dfcb9d1999b, b6c4fcb8303f49f2bf609b4ec2a4a726; no voters:
I20260812 00:28:20.110206 10141 raft_consensus.cc:2781] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:20.110672 10141 raft_consensus.cc:686] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 LEADER]: Becoming Leader. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Running, Role: LEADER
I20260812 00:28:20.111181 10141 consensus_queue.cc:237] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.113144 10188 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: TxnStatusTablet state changed. Reason: New leader b6c4fcb8303f49f2bf609b4ec2a4a726. Latest consensus state: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:20.113444 10188 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:28:20.114065 10190 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 00:28:20.114326 10190 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 00:28:20.115388 9398 catalog_manager.cc:5495] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } health_report { overall_health: UNKNOWN } } }
I20260812 00:28:20.136276 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.130826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34278 (local address 127.29.190.130:35011)
0812 00:28:20.131063 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:20.131070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:20.131090 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:28:20.131401 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:20.131406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:20.131558 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:20.131653 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:20.132136 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.132921 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.134260 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.134733 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.134884 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.135394 (+ 510us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:20.135609 (+ 215us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:20.135716 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:20.135879 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 00:28:20.135967 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 00:28:20.136317 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.130679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:35011 (local address 127.0.0.1:34278)
0812 00:28:20.130988 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:20.131012 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:20.131191 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:20.131689 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:20.131694 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:20.131777 (+ 83us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:28:20.131983 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:20.132000 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.133069 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.133075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:20.134102 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:20.134114 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.134914 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.134920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:20.135115 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.135176 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:28:20.135719 (+ 543us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:28:20.135746 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 00:28:20.135850 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:28:20.136040 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 00:28:20.141348 10015 raft_consensus.cc:1261] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Refusing update from remote peer b6c4fcb8303f49f2bf609b4ec2a4a726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:20.141623 9613 raft_consensus.cc:1261] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Refusing update from remote peer b6c4fcb8303f49f2bf609b4ec2a4a726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:20.142073 10188 consensus_queue.cc:1035] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:20.142419 10141 consensus_queue.cc:1035] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:20.146752 10133 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: TxnStatusTablet state changed. Reason: New leader b6c4fcb8303f49f2bf609b4ec2a4a726. Latest consensus state: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:20.147032 10133 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:28:20.150031 10197 mvcc.cc:205] Tried to move back new op lower bound from 7317481472572432384 to 7317481472458063872. Current Snapshot: MvccSnapshot[applied={T|T < 7317481472572432384}]
I20260812 00:28:20.153525 10195 mvcc.cc:205] Tried to move back new op lower bound from 7317481472572432384 to 7317481472458063872. Current Snapshot: MvccSnapshot[applied={T|T < 7317481472572432384}]
I20260812 00:28:20.158722 10188 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:20.159013 10188 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:28:20.161399 10133 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:20.161734 10133 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P 82585d277f7f4a839f645dfcb9d1999b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:28:20.163144 10131 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: TxnStatusTablet state changed. Reason: New leader b6c4fcb8303f49f2bf609b4ec2a4a726. Latest consensus state: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:20.163537 10131 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:28:20.169133 10188 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:20.169504 10188 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P b6c4fcb8303f49f2bf609b4ec2a4a726: This TxnStatusTablet replica's current role is: LEADER
I20260812 00:28:20.172015 10131 tablet_replica.cc:439] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } } }
I20260812 00:28:20.172297 10131 tablet_replica.cc:442] T 03f834d91dee4b2b852f206c40f2d2b5 P 06261aac331b4baead4e301edd5083bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 00:28:20.182850 10210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.176665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53624 (local address 127.29.190.131:36621)
0812 00:28:20.177414 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:20.177421 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:20.177441 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:28:20.177553 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:20.177557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:20.177636 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:20.177826 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:20.178276 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.179068 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.180522 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.180995 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.181143 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.181602 (+ 459us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:20.182201 (+ 599us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:20.182366 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:20.182431 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 00:28:20.182517 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":454,"threads_started":1}
I20260812 00:28:20.200683 10213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.194176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:35011 (local address 127.29.190.131:60533)
0812 00:28:20.194941 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:20.194958 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:20.195082 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:20.195525 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:20.195530 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:20.195553 (+ 23us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:28:20.195838 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:20.195847 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.197332 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.197336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:20.198422 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:20.198435 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.199552 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.199557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:20.199679 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.199736 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:28:20.200203 (+ 467us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:28:20.200211 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 00:28:20.200271 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 00:28:20.200373 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":398,"threads_started":1}
I20260812 00:28:20.200714 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.194182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:60533 (local address 127.29.190.130:35011)
0812 00:28:20.194406 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:20.194413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:20.195044 (+ 631us) server_negotiation.cc:407] Connection header received
0812 00:28:20.195211 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:20.195216 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:20.195312 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:20.195415 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:20.196015 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.197196 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.198568 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.199298 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.199422 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.199932 (+ 510us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:20.200104 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:20.200195 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:20.200323 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 00:28:20.200407 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:28:20.215355 9613 raft_consensus.cc:1261] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Refusing update from remote peer 82585d277f7f4a839f645dfcb9d1999b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:20.215574 9827 raft_consensus.cc:1261] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Refusing update from remote peer 82585d277f7f4a839f645dfcb9d1999b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:20.216249 10174 consensus_queue.cc:1035] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:20.219251 10174 consensus_queue.cc:1035] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:20.230363 10198 mvcc.cc:205] Tried to move back new op lower bound from 7317481472874541056 to 7317481471407390720. Current Snapshot: MvccSnapshot[applied={T|T < 7317481472874541056}]
I20260812 00:28:20.273422 10210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.266422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:55839 (local address 127.29.190.131:36621)
0812 00:28:20.266643 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:20.266652 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:20.267380 (+ 728us) server_negotiation.cc:407] Connection header received
0812 00:28:20.267643 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:20.267647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:20.267759 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:20.267855 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:20.268479 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.269256 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.271526 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.272048 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.272194 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.272718 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:20.272854 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:20.272944 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:20.273148 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 00:28:20.273215 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 00:28:20.273914 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.266475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:36621 (local address 127.29.190.130:55839)
0812 00:28:20.267274 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:20.267293 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:20.267486 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:20.267892 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:20.267896 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:20.267911 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:28:20.268330 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:20.268348 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.269402 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.269408 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:20.271350 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:20.271367 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.272205 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.272211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:20.272418 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.272500 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:28:20.272998 (+ 498us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:28:20.273009 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:28:20.273103 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 00:28:20.273248 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":388,"threads_started":1}
I20260812 00:28:20.314136 9398 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:20.314422 9398 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:20.318333 9398 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: Sending DeleteTablet for 3 replicas of tablet 7a81a43b0a6145c19b715a0f75724c44
I20260812 00:28:20.319332 9588 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a81a43b0a6145c19b715a0f75724c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:20 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:46242
I20260812 00:28:20.319664 9984 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a81a43b0a6145c19b715a0f75724c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:20 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:53614
I20260812 00:28:20.320658 9790 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a81a43b0a6145c19b715a0f75724c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:20 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:34260
I20260812 00:28:20.331324 10236 tablet_replica.cc:330] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: stopping tablet replica
I20260812 00:28:20.331624 10236 raft_consensus.cc:2229] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:20.332099 10236 raft_consensus.cc:2258] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:20.333546 10236 ts_tablet_manager.cc:1905] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:20.349677 10233 tablet_replica.cc:330] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: stopping tablet replica
I20260812 00:28:20.349941 10233 raft_consensus.cc:2229] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:28:20.350607 10233 raft_consensus.cc:2258] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:20.356833 10236 ts_tablet_manager.cc:1918] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:28:20.358171 10233 ts_tablet_manager.cc:1905] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:20.363559 10236 log.cc:1196] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/7a81a43b0a6145c19b715a0f75724c44
I20260812 00:28:20.364158 10236 ts_tablet_manager.cc:1939] T 7a81a43b0a6145c19b715a0f75724c44 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting consensus metadata
I20260812 00:28:20.365196 10231 tablet_replica.cc:330] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: stopping tablet replica
I20260812 00:28:20.365423 10231 raft_consensus.cc:2229] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:20.365722 10231 raft_consensus.cc:2258] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:20.368597 9376 catalog_manager.cc:4841] TS b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130:35011): tablet 7a81a43b0a6145c19b715a0f75724c44 (table test-table [id=bda16e887d2248b78655d2bcb34d99ba]) successfully deleted
I20260812 00:28:20.370128 10231 ts_tablet_manager.cc:1905] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:20.377830 10231 ts_tablet_manager.cc:1918] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:28:20.378121 10231 log.cc:1196] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/7a81a43b0a6145c19b715a0f75724c44
I20260812 00:28:20.378664 10231 ts_tablet_manager.cc:1939] T 7a81a43b0a6145c19b715a0f75724c44 P 06261aac331b4baead4e301edd5083bf: Deleting consensus metadata
I20260812 00:28:20.379969 9382 catalog_manager.cc:4841] TS 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479): tablet 7a81a43b0a6145c19b715a0f75724c44 (table test-table [id=bda16e887d2248b78655d2bcb34d99ba]) successfully deleted
I20260812 00:28:20.381963 10233 ts_tablet_manager.cc:1918] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:28:20.382107 10233 log.cc:1196] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/7a81a43b0a6145c19b715a0f75724c44
I20260812 00:28:20.382511 10233 ts_tablet_manager.cc:1939] T 7a81a43b0a6145c19b715a0f75724c44 P 82585d277f7f4a839f645dfcb9d1999b: Deleting consensus metadata
I20260812 00:28:20.383764 9376 catalog_manager.cc:4841] TS 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621): tablet 7a81a43b0a6145c19b715a0f75724c44 (table test-table [id=bda16e887d2248b78655d2bcb34d99ba]) successfully deleted
Aug 12 00:28:20 dist-test-slave-c12x krb5kdc[9334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 00:28:20 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:20 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:28:20.429971 10182 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:20.418724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43818 (local address 127.29.190.190:39329)
0812 00:28:20.418977 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:20.418988 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:20.419562 (+ 574us) server_negotiation.cc:407] Connection header received
0812 00:28:20.419876 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:20.419882 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:20.419979 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:20.420063 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:20.421638 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.422493 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.423844 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.424459 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.424621 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.429767 (+ 5146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43818: BlockingRecv error: recv got EOF from 127.0.0.1:43818 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 12 00:28:20 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM
I20260812 00:28:20.449697 10182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.434471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43824 (local address 127.29.190.190:39329)
0812 00:28:20.434656 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:20.434660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:20.435335 (+ 675us) server_negotiation.cc:407] Connection header received
0812 00:28:20.435589 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:20.435593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:20.435657 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:20.435769 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:20.437147 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.437886 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.439313 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.439922 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.440066 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.444090 (+ 4024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:20.444096 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:20.444099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:20.444147 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:20.446905 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:20.447653 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:20.447659 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:20.447668 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:20.447800 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:20.448201 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:20.448206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:20.448208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:20.448484 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:20.448784 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:20.449073 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 00:28:20.449326 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:28:20.453548 9398 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:28:20.454237 9398 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:28:20.461699 9588 tablet_service.cc:1467] Processing CreateTablet for tablet 590887630f2d42628f57f0e9c313ea0c (DEFAULT_TABLE table=test-table [id=7d6f33ca30e24418b882677dd8f7bff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:20.461932 9790 tablet_service.cc:1467] Processing CreateTablet for tablet 590887630f2d42628f57f0e9c313ea0c (DEFAULT_TABLE table=test-table [id=7d6f33ca30e24418b882677dd8f7bff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:20.462193 9588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590887630f2d42628f57f0e9c313ea0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:20.462167 9984 tablet_service.cc:1467] Processing CreateTablet for tablet 590887630f2d42628f57f0e9c313ea0c (DEFAULT_TABLE table=test-table [id=7d6f33ca30e24418b882677dd8f7bff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:20.462406 9790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590887630f2d42628f57f0e9c313ea0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:20.462584 9984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590887630f2d42628f57f0e9c313ea0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:20.469472 10126 tablet_bootstrap.cc:492] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: Bootstrap starting.
I20260812 00:28:20.469985 10124 tablet_bootstrap.cc:492] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: Bootstrap starting.
I20260812 00:28:20.471300 10126 tablet_bootstrap.cc:654] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:20.471899 10124 tablet_bootstrap.cc:654] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:20.475274 10127 tablet_bootstrap.cc:492] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: Bootstrap starting.
I20260812 00:28:20.477246 10127 tablet_bootstrap.cc:654] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:20.478189 10124 tablet_bootstrap.cc:492] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: No bootstrap required, opened a new log
I20260812 00:28:20.478427 10124 ts_tablet_manager.cc:1397] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 00:28:20.478917 10126 tablet_bootstrap.cc:492] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: No bootstrap required, opened a new log
I20260812 00:28:20.479076 10126 ts_tablet_manager.cc:1397] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.004s
I20260812 00:28:20.479957 10126 raft_consensus.cc:348] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.479970 10124 raft_consensus.cc:348] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.480242 10126 raft_consensus.cc:374] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:20.480334 10126 raft_consensus.cc:729] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06261aac331b4baead4e301edd5083bf, State: Initialized, Role: FOLLOWER
I20260812 00:28:20.480382 10124 raft_consensus.cc:374] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:20.480630 10124 raft_consensus.cc:729] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82585d277f7f4a839f645dfcb9d1999b, State: Initialized, Role: FOLLOWER
I20260812 00:28:20.480636 10126 consensus_queue.cc:260] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.481069 10124 consensus_queue.cc:260] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.481768 10124 ts_tablet_manager.cc:1428] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:20.485200 10126 ts_tablet_manager.cc:1428] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260812 00:28:20.492682 10127 tablet_bootstrap.cc:492] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: No bootstrap required, opened a new log
I20260812 00:28:20.492905 10127 ts_tablet_manager.cc:1397] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260812 00:28:20.493767 10127 raft_consensus.cc:348] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.494118 10127 raft_consensus.cc:374] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:20.494248 10127 raft_consensus.cc:729] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Initialized, Role: FOLLOWER
I20260812 00:28:20.494521 10127 consensus_queue.cc:260] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.495175 10127 ts_tablet_manager.cc:1428] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260812 00:28:20.684394 10188 raft_consensus.cc:482] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:28:20.684702 10188 raft_consensus.cc:504] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.685385 10188 leader_election.cc:288] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:20.686062 10013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590887630f2d42628f57f0e9c313ea0c" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82585d277f7f4a839f645dfcb9d1999b" is_pre_election: true
I20260812 00:28:20.686146 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590887630f2d42628f57f0e9c313ea0c" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf" is_pre_election: true
I20260812 00:28:20.686390 10013 raft_consensus.cc:2454] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 0.
I20260812 00:28:20.686390 9613 raft_consensus.cc:2454] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 0.
I20260812 00:28:20.686940 9719 leader_election.cc:302] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82585d277f7f4a839f645dfcb9d1999b, b6c4fcb8303f49f2bf609b4ec2a4a726; no voters:
I20260812 00:28:20.687232 10188 raft_consensus.cc:2781] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:28:20.687340 10188 raft_consensus.cc:482] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:28:20.687486 10188 raft_consensus.cc:3037] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:20.689545 10188 raft_consensus.cc:504] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.690189 10188 leader_election.cc:288] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 election: Requested vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:20.690724 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590887630f2d42628f57f0e9c313ea0c" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf"
I20260812 00:28:20.690778 10013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590887630f2d42628f57f0e9c313ea0c" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82585d277f7f4a839f645dfcb9d1999b"
I20260812 00:28:20.690997 10013 raft_consensus.cc:3037] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:20.691004 9613 raft_consensus.cc:3037] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:20.693336 10013 raft_consensus.cc:2454] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 1.
I20260812 00:28:20.693881 9719 leader_election.cc:302] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82585d277f7f4a839f645dfcb9d1999b, b6c4fcb8303f49f2bf609b4ec2a4a726; no voters:
I20260812 00:28:20.694216 10188 raft_consensus.cc:2781] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:20.694418 10188 raft_consensus.cc:686] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 LEADER]: Becoming Leader. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Running, Role: LEADER
I20260812 00:28:20.694706 10188 consensus_queue.cc:237] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.695309 9613 raft_consensus.cc:2454] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 1.
I20260812 00:28:20.698378 9398 catalog_manager.cc:5495] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } health_report { overall_health: UNKNOWN } } }
I20260812 00:28:20.742300 10262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:20.736405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34282 (local address 127.29.190.130:35011)
0812 00:28:20.736990 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:20.736996 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:20.737013 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:28:20.737080 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:20.737084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:20.737163 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:20.737315 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:20.737768 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.738672 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.740307 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:20.740798 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:20.740979 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:20.741459 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:20.741584 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:20.741696 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:20.741858 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 00:28:20.741946 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":310,"threads_started":1}
I20260812 00:28:20.745831 9613 raft_consensus.cc:1261] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Refusing update from remote peer b6c4fcb8303f49f2bf609b4ec2a4a726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:20.745837 10013 raft_consensus.cc:1261] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Refusing update from remote peer b6c4fcb8303f49f2bf609b4ec2a4a726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:20.746548 10141 consensus_queue.cc:1035] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:20.747154 10141 consensus_queue.cc:1035] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:20.764528 9398 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:20.764899 9398 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:20.770583 9398 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: Sending DeleteTablet for 3 replicas of tablet 590887630f2d42628f57f0e9c313ea0c
I20260812 00:28:20.772048 9588 tablet_service.cc:1514] Processing DeleteTablet for tablet 590887630f2d42628f57f0e9c313ea0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:20 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:46242
I20260812 00:28:20.772121 9984 tablet_service.cc:1514] Processing DeleteTablet for tablet 590887630f2d42628f57f0e9c313ea0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:20 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:53614
I20260812 00:28:20.772408 10233 tablet_replica.cc:330] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: stopping tablet replica
I20260812 00:28:20.772398 9790 tablet_service.cc:1514] Processing DeleteTablet for tablet 590887630f2d42628f57f0e9c313ea0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:20 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:34260
I20260812 00:28:20.772526 10231 tablet_replica.cc:330] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: stopping tablet replica
I20260812 00:28:20.772478 9789 tablet_service.cc:1514] Processing DeleteTablet for tablet 590887630f2d42628f57f0e9c313ea0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:20 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:34260
I20260812 00:28:20.772631 10233 raft_consensus.cc:2229] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:20.772714 10231 raft_consensus.cc:2229] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:20.772833 10233 raft_consensus.cc:2258] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:20.772935 10231 raft_consensus.cc:2258] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:20.773059 10236 tablet_replica.cc:330] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: stopping tablet replica
I20260812 00:28:20.773281 10236 raft_consensus.cc:2229] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:28:20.773661 10236 raft_consensus.cc:2258] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:20.774487 10231 ts_tablet_manager.cc:1905] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:20.775084 10236 ts_tablet_manager.cc:1905] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:20.777544 9396 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:28:20.778307 9396 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:28:20.780509 10231 ts_tablet_manager.cc:1918] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:20.780671 10231 log.cc:1196] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/590887630f2d42628f57f0e9c313ea0c
I20260812 00:28:20.781121 10231 ts_tablet_manager.cc:1939] T 590887630f2d42628f57f0e9c313ea0c P 06261aac331b4baead4e301edd5083bf: Deleting consensus metadata
I20260812 00:28:20.782232 9382 catalog_manager.cc:4841] TS 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479): tablet 590887630f2d42628f57f0e9c313ea0c (table test-table [id=7d6f33ca30e24418b882677dd8f7bff9]) successfully deleted
I20260812 00:28:20.785006 10236 ts_tablet_manager.cc:1918] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:20.785185 10236 log.cc:1196] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/590887630f2d42628f57f0e9c313ea0c
I20260812 00:28:20.785636 10236 ts_tablet_manager.cc:1939] T 590887630f2d42628f57f0e9c313ea0c P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting consensus metadata
I20260812 00:28:20.786888 10233 ts_tablet_manager.cc:1905] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:20.787600 9588 tablet_service.cc:1467] Processing CreateTablet for tablet a90b7a767fdb4830ad9063e56b949a46 (DEFAULT_TABLE table=test-table [id=1c8db6c341b04c5480af703afba1d3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:20.788023 9588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a90b7a767fdb4830ad9063e56b949a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:20.788232 9376 catalog_manager.cc:4841] TS b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130:35011): tablet 590887630f2d42628f57f0e9c313ea0c (table test-table [id=7d6f33ca30e24418b882677dd8f7bff9]) successfully deleted
W20260812 00:28:20.788628 9376 catalog_manager.cc:4808] TS b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130:35011): delete failed for tablet 590887630f2d42628f57f0e9c313ea0c because the tablet was not found. No further retry: Not found: Tablet not found: 590887630f2d42628f57f0e9c313ea0c
I20260812 00:28:20.789426 9984 tablet_service.cc:1467] Processing CreateTablet for tablet a90b7a767fdb4830ad9063e56b949a46 (DEFAULT_TABLE table=test-table [id=1c8db6c341b04c5480af703afba1d3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:20.789871 9984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a90b7a767fdb4830ad9063e56b949a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:20.794380 10126 tablet_bootstrap.cc:492] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: Bootstrap starting.
I20260812 00:28:20.794724 9789 tablet_service.cc:1467] Processing CreateTablet for tablet a90b7a767fdb4830ad9063e56b949a46 (DEFAULT_TABLE table=test-table [id=1c8db6c341b04c5480af703afba1d3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:20.795271 9789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a90b7a767fdb4830ad9063e56b949a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:20.796119 10126 tablet_bootstrap.cc:654] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:20.798338 10126 tablet_bootstrap.cc:492] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: No bootstrap required, opened a new log
I20260812 00:28:20.798514 10126 ts_tablet_manager.cc:1397] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 00:28:20.799269 10126 raft_consensus.cc:348] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.799578 10126 raft_consensus.cc:374] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:20.799666 10126 raft_consensus.cc:729] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06261aac331b4baead4e301edd5083bf, State: Initialized, Role: FOLLOWER
I20260812 00:28:20.800341 10127 tablet_bootstrap.cc:492] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: Bootstrap starting.
I20260812 00:28:20.801721 10233 ts_tablet_manager.cc:1918] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:20.801905 10233 log.cc:1196] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/590887630f2d42628f57f0e9c313ea0c
I20260812 00:28:20.802100 10127 tablet_bootstrap.cc:654] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:20.803117 10233 ts_tablet_manager.cc:1939] T 590887630f2d42628f57f0e9c313ea0c P 82585d277f7f4a839f645dfcb9d1999b: Deleting consensus metadata
I20260812 00:28:20.803524 10124 tablet_bootstrap.cc:492] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: Bootstrap starting.
I20260812 00:28:20.803522 10126 consensus_queue.cc:260] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.804126 10126 ts_tablet_manager.cc:1428] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260812 00:28:20.805251 10124 tablet_bootstrap.cc:654] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:20.806505 9376 catalog_manager.cc:4841] TS 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621): tablet 590887630f2d42628f57f0e9c313ea0c (table test-table [id=7d6f33ca30e24418b882677dd8f7bff9]) successfully deleted
I20260812 00:28:20.808038 10124 tablet_bootstrap.cc:492] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: No bootstrap required, opened a new log
I20260812 00:28:20.808252 10124 ts_tablet_manager.cc:1397] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 00:28:20.809409 10124 raft_consensus.cc:348] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.809753 10124 raft_consensus.cc:374] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:20.809849 10124 raft_consensus.cc:729] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82585d277f7f4a839f645dfcb9d1999b, State: Initialized, Role: FOLLOWER
I20260812 00:28:20.810245 10124 consensus_queue.cc:260] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.811607 10124 ts_tablet_manager.cc:1428] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:20.812407 10127 tablet_bootstrap.cc:492] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: No bootstrap required, opened a new log
I20260812 00:28:20.812615 10127 ts_tablet_manager.cc:1397] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.007s
I20260812 00:28:20.813498 10127 raft_consensus.cc:348] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.814024 10127 raft_consensus.cc:374] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:20.814368 10127 raft_consensus.cc:729] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Initialized, Role: FOLLOWER
I20260812 00:28:20.814868 10127 consensus_queue.cc:260] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:20.815542 10127 ts_tablet_manager.cc:1428] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260812 00:28:21.111372 10141 raft_consensus.cc:482] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:28:21.111714 10141 raft_consensus.cc:504] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:21.112428 10141 leader_election.cc:288] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:21.113112 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90b7a767fdb4830ad9063e56b949a46" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf" is_pre_election: true
I20260812 00:28:21.113168 10013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90b7a767fdb4830ad9063e56b949a46" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82585d277f7f4a839f645dfcb9d1999b" is_pre_election: true
I20260812 00:28:21.113353 9613 raft_consensus.cc:2454] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 0.
I20260812 00:28:21.113567 10013 raft_consensus.cc:2454] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 0.
I20260812 00:28:21.113914 9725 leader_election.cc:302] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06261aac331b4baead4e301edd5083bf, b6c4fcb8303f49f2bf609b4ec2a4a726; no voters:
I20260812 00:28:21.114255 10141 raft_consensus.cc:2781] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:28:21.114392 10141 raft_consensus.cc:482] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:28:21.114539 10141 raft_consensus.cc:3037] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:21.116914 10141 raft_consensus.cc:504] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:21.117596 10141 leader_election.cc:288] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 election: Requested vote from peers 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479), 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621)
I20260812 00:28:21.118230 10013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90b7a767fdb4830ad9063e56b949a46" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82585d277f7f4a839f645dfcb9d1999b"
I20260812 00:28:21.118230 9613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90b7a767fdb4830ad9063e56b949a46" candidate_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06261aac331b4baead4e301edd5083bf"
I20260812 00:28:21.118459 10013 raft_consensus.cc:3037] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:21.118474 9613 raft_consensus.cc:3037] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:21.121555 10013 raft_consensus.cc:2454] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 1.
I20260812 00:28:21.121555 9613 raft_consensus.cc:2454] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c4fcb8303f49f2bf609b4ec2a4a726 in term 1.
I20260812 00:28:21.122068 9725 leader_election.cc:302] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06261aac331b4baead4e301edd5083bf, b6c4fcb8303f49f2bf609b4ec2a4a726; no voters:
I20260812 00:28:21.122422 10141 raft_consensus.cc:2781] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:21.122655 10141 raft_consensus.cc:686] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 LEADER]: Becoming Leader. State: Replica: b6c4fcb8303f49f2bf609b4ec2a4a726, State: Running, Role: LEADER
I20260812 00:28:21.122995 10141 consensus_queue.cc:237] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } }
I20260812 00:28:21.126016 9397 catalog_manager.cc:5495] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6c4fcb8303f49f2bf609b4ec2a4a726" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 } health_report { overall_health: UNKNOWN } } }
I20260812 00:28:21.202009 10262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:21.196822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:38111 (local address 127.29.190.130:35011)
0812 00:28:21.197105 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:21.197111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:21.197360 (+ 249us) server_negotiation.cc:407] Connection header received
0812 00:28:21.197576 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:21.197581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:21.197645 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:21.197737 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:21.198198 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.198915 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.200316 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.200717 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.200853 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:21.201228 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:21.201368 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:21.201460 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:21.201602 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 00:28:21.201674 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260812 00:28:21.202126 10275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:21.196610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:35011 (local address 127.29.190.130:38111)
0812 00:28:21.197256 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:21.197270 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:21.197444 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:21.197759 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:21.197763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:21.197773 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 00:28:21.198033 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:21.198042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.199053 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.199061 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:21.200173 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:21.200186 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.200879 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.200884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:21.201025 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:21.201060 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 00:28:21.201474 (+ 414us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 00:28:21.201486 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:28:21.201583 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 00:28:21.201712 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":376,"threads_started":1}
I20260812 00:28:21.210547 10013 raft_consensus.cc:1261] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Refusing update from remote peer b6c4fcb8303f49f2bf609b4ec2a4a726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:21.210547 9613 raft_consensus.cc:1261] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Refusing update from remote peer b6c4fcb8303f49f2bf609b4ec2a4a726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:21.211289 10141 consensus_queue.cc:1035] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82585d277f7f4a839f645dfcb9d1999b" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:21.211786 10214 consensus_queue.cc:1035] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06261aac331b4baead4e301edd5083bf" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:21.271586 9397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:21.271812 9397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:21.275069 9397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c201304e3f774c84a9e01531e684d0b7: Sending DeleteTablet for 3 replicas of tablet a90b7a767fdb4830ad9063e56b949a46
I20260812 00:28:21.276000 9588 tablet_service.cc:1514] Processing DeleteTablet for tablet a90b7a767fdb4830ad9063e56b949a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:21 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:46242
I20260812 00:28:21.276016 9789 tablet_service.cc:1514] Processing DeleteTablet for tablet a90b7a767fdb4830ad9063e56b949a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:21 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:34260
I20260812 00:28:21.276109 9984 tablet_service.cc:1514] Processing DeleteTablet for tablet a90b7a767fdb4830ad9063e56b949a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:21 UTC) from {username='oryx', principal='oryx/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:53614
I20260812 00:28:21.276331 10231 tablet_replica.cc:330] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: stopping tablet replica
I20260812 00:28:21.276413 10236 tablet_replica.cc:330] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: stopping tablet replica
I20260812 00:28:21.276475 10233 tablet_replica.cc:330] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: stopping tablet replica
I20260812 00:28:21.276520 10231 raft_consensus.cc:2229] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:21.276585 10236 raft_consensus.cc:2229] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:28:21.276662 10233 raft_consensus.cc:2229] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:21.276757 10231 raft_consensus.cc:2258] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:21.276929 10236 raft_consensus.cc:2258] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:21.276917 10233 raft_consensus.cc:2258] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:21.276947 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 9497
I20260812 00:28:21.278527 10233 ts_tablet_manager.cc:1905] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:21.278601 10231 ts_tablet_manager.cc:1905] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:21.279233 10236 ts_tablet_manager.cc:1905] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:21.286167 10233 ts_tablet_manager.cc:1918] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:28:21.286603 10233 log.cc:1196] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/a90b7a767fdb4830ad9063e56b949a46
I20260812 00:28:21.287339 10233 ts_tablet_manager.cc:1939] T a90b7a767fdb4830ad9063e56b949a46 P 82585d277f7f4a839f645dfcb9d1999b: Deleting consensus metadata
I20260812 00:28:21.288092 10231 ts_tablet_manager.cc:1918] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:28:21.288309 10231 log.cc:1196] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/a90b7a767fdb4830ad9063e56b949a46
I20260812 00:28:21.288520 10236 ts_tablet_manager.cc:1918] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 00:28:21.288725 10236 log.cc:1196] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/a90b7a767fdb4830ad9063e56b949a46
I20260812 00:28:21.288750 9376 catalog_manager.cc:4841] TS 82585d277f7f4a839f645dfcb9d1999b (127.29.190.131:36621): tablet a90b7a767fdb4830ad9063e56b949a46 (table test-table [id=1c8db6c341b04c5480af703afba1d3eb]) successfully deleted
I20260812 00:28:21.288938 10231 ts_tablet_manager.cc:1939] T a90b7a767fdb4830ad9063e56b949a46 P 06261aac331b4baead4e301edd5083bf: Deleting consensus metadata
I20260812 00:28:21.289279 10236 ts_tablet_manager.cc:1939] T a90b7a767fdb4830ad9063e56b949a46 P b6c4fcb8303f49f2bf609b4ec2a4a726: Deleting consensus metadata
I20260812 00:28:21.290217 9382 catalog_manager.cc:4841] TS 06261aac331b4baead4e301edd5083bf (127.29.190.129:35479): tablet a90b7a767fdb4830ad9063e56b949a46 (table test-table [id=1c8db6c341b04c5480af703afba1d3eb]) successfully deleted
I20260812 00:28:21.290308 9376 catalog_manager.cc:4841] TS b6c4fcb8303f49f2bf609b4ec2a4a726 (127.29.190.130:35011): tablet a90b7a767fdb4830ad9063e56b949a46 (table test-table [id=1c8db6c341b04c5480af703afba1d3eb]) successfully deleted
Aug 12 00:28:21 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.129@KRBTEST.COM
I20260812 00:28:21.305249 10284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:21.278464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46244 (local address 127.29.190.129:35479)
0812 00:28:21.287989 (+ 9525us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:21.287995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:21.288018 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:28:21.288618 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:21.288627 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:21.288759 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:21.288884 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:21.290832 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.291791 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.293263 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.293766 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.293891 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:21.298316 (+ 4425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:21.298335 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:21.298354 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:21.298396 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:21.301909 (+ 3513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:21.302891 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:21.302908 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:21.302911 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:21.303063 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:21.303534 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:21.303543 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:21.303547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:21.303980 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:21.304223 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:21.304741 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 00:28:21.304961 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9375,"thread_start_us":10012,"threads_started":1}
I20260812 00:28:21.305950 9679 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:21.419003 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 9497
I20260812 00:28:21.445066 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 9693
Aug 12 00:28:21 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.130@KRBTEST.COM
I20260812 00:28:21.461606 10262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:21.446022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34286 (local address 127.29.190.130:35011)
0812 00:28:21.446234 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:21.446240 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:21.446263 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:28:21.446347 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:21.446359 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:21.446439 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:21.446559 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:21.447942 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.448682 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.449991 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.450431 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.450576 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:21.455288 (+ 4712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:21.455308 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:21.455326 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:21.455371 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:21.458487 (+ 3116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:21.459239 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:21.459248 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:21.459250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:21.459396 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:21.459919 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:21.459924 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:21.459926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:21.460345 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:21.460621 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:21.460992 (+ 371us) server_negotiation.cc:299] Negotiation successful
0812 00:28:21.461177 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:28:21.462415 9881 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:21.614291 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 9693
I20260812 00:28:21.652722 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 9893
Aug 12 00:28:21 dist-test-slave-c12x krb5kdc[9334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.190.131@KRBTEST.COM
I20260812 00:28:21.669951 10288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:21.653569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53634 (local address 127.29.190.131:36621)
0812 00:28:21.654066 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:21.654070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:21.654088 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:28:21.654147 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:21.654150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:21.654219 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:21.654314 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:21.655722 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.656492 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.657904 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:21.658303 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:21.658406 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:21.663026 (+ 4620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:21.663046 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:21.663066 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:21.663109 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:21.666724 (+ 3615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:21.667587 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:21.667596 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:21.667599 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:21.667757 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:21.668201 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:21.668206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:21.668208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:21.668617 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:21.668875 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:21.669221 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 00:28:21.669518 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":272,"threads_started":1}
I20260812 00:28:21.670820 10083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:21.797991 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 9893
I20260812 00:28:21.830197 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 9348
I20260812 00:28:21.831713 9452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:21.952023 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 9348
2026-08-12T00:28:21Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6785 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:28:22 dist-test-slave-c12x krb5kdc[10294](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:28:22 dist-test-slave-c12x krb5kdc[10294](info): set up 2 sockets
Aug 12 00:28:22 dist-test-slave-c12x krb5kdc[10294](info): commencing operation
krb5kdc: starting...
W20260812 00:28:23.291028 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:28:23 dist-test-slave-c12x krb5kdc[10294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:28:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:28:23.570791 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:39589
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:39589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:23.935153 10310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:23.935567 10310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:23.935747 10310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:23.943254 10310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:23.943368 10310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:23.943418 10310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:23.943564 10310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:23.943658 10310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:23.953960 10310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:39589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:39589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:23.955374 10310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:23.956818 10310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:23.969698 10316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:23.969736 10317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:23.970052 10320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:23.970975 10310 server_base.cc:1034] running on GCE node
I20260812 00:28:23.971999 10310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:23.973613 10310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:23.974870 10310 hybrid_clock.cc:648] HybridClock initialized: now 1786494503974815 us; error 29 us; skew 500 ppm
I20260812 00:28:23.975342 10310 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T00:28:24Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2092 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:28:24 dist-test-slave-c12x krb5kdc[10327](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:28:24 dist-test-slave-c12x krb5kdc[10327](info): set up 2 sockets
Aug 12 00:28:24 dist-test-slave-c12x krb5kdc[10327](info): commencing operation
krb5kdc: starting...
W20260812 00:28:25.410495 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:28:25 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:28:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:28:25.704259 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42953
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:42953
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:26.067873 10354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:26.068161 10354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:26.068253 10354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:26.075690 10354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:26.075814 10354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:26.075868 10354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:26.075920 10354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:26.075965 10354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:26.086099 10354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:42953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:26.087512 10354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:26.088822 10354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:26.101383 10365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:26.101424 10363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:26.101641 10361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:26.102099 10354 server_base.cc:1034] running on GCE node
I20260812 00:28:26.103160 10354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:26.104803 10354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:26.106081 10354 hybrid_clock.cc:648] HybridClock initialized: now 1786494506106003 us; error 69 us; skew 500 ppm
I20260812 00:28:26.106487 10354 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:26 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494506, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:26.110401 10354 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:28:26.112061 10354 webserver.cc:460] Webserver started at http://127.29.190.190:44771/ using document root <none> and password file <none>
I20260812 00:28:26.112778 10354 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:26.112927 10354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:26.113278 10354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:26.116380 10354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "2dc015828a3d4e79ad3491fc23072d75"
format_stamp: "Formatted at 2026-08-12 00:28:26 on dist-test-slave-c12x"
server_key: "f9366275f71f9164f237fbcaac1dc1c9"
server_key_iv: "85e746c74fb80e196efd36642c7caa59"
server_key_version: "encryptionkey@0"
I20260812 00:28:26.117152 10354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "2dc015828a3d4e79ad3491fc23072d75"
format_stamp: "Formatted at 2026-08-12 00:28:26 on dist-test-slave-c12x"
server_key: "f9366275f71f9164f237fbcaac1dc1c9"
server_key_iv: "85e746c74fb80e196efd36642c7caa59"
server_key_version: "encryptionkey@0"
I20260812 00:28:26.122453 10354 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260812 00:28:26.126137 10375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:26.127689 10354 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:26.127892 10354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "2dc015828a3d4e79ad3491fc23072d75"
format_stamp: "Formatted at 2026-08-12 00:28:26 on dist-test-slave-c12x"
server_key: "f9366275f71f9164f237fbcaac1dc1c9"
server_key_iv: "85e746c74fb80e196efd36642c7caa59"
server_key_version: "encryptionkey@0"
I20260812 00:28:26.128118 10354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:26.148144 10354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:26.152940 10354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:26.153264 10354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:26.173944 10354 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:42953
I20260812 00:28:26.173971 10445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:42953 every 8 connection(s)
I20260812 00:28:26.175490 10354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:28:26.179548 10446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:26.183542 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 10354
I20260812 00:28:26.183786 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:28:26.184435 30458 external_mini_cluster.cc:1428] Setting key d31c485fdd35bb4ed81dd1e08637ebe3
I20260812 00:28:26.192680 10446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Bootstrap starting.
I20260812 00:28:26.196905 10446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:26.198395 10446 log.cc:824] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:26.201956 10446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: No bootstrap required, opened a new log
Aug 12 00:28:26 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:26.211108 10452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:26.186668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34196 (local address 127.29.190.190:42953)
0812 00:28:26.187611 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:26.187629 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:26.187682 (+ 53us) server_negotiation.cc:407] Connection header received
0812 00:28:26.190769 (+ 3087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:26.190801 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:26.191339 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:26.191834 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:26.193354 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:26.195663 (+ 2309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:26.197061 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:26.198161 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:26.198363 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:26.203163 (+ 4800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:26.203173 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:26.203192 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:26.203242 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:26.206736 (+ 3494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:26.207629 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:26.207636 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:26.207643 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:26.207824 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:26.208252 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:26.208255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:26.208257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:26.208853 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:26.209125 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:26.209591 (+ 466us) server_negotiation.cc:299] Negotiation successful
0812 00:28:26.210050 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":391,"threads_started":1}
I20260812 00:28:26.210966 10446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } }
I20260812 00:28:26.211550 10446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:26.211685 10446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc015828a3d4e79ad3491fc23072d75, State: Initialized, Role: FOLLOWER
I20260812 00:28:26.212265 10446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } }
I20260812 00:28:26.212531 10446 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:28:26.212694 10446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:28:26.212903 10446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:26.215276 10446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } }
I20260812 00:28:26.215847 10446 leader_election.cc:302] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dc015828a3d4e79ad3491fc23072d75; no voters:
I20260812 00:28:26.216472 10446 leader_election.cc:288] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:28:26.216666 10454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:26.217875 10454 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 1 LEADER]: Becoming Leader. State: Replica: 2dc015828a3d4e79ad3491fc23072d75, State: Running, Role: LEADER
I20260812 00:28:26.218509 10454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } }
I20260812 00:28:26.218786 10446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:26.221421 10458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dc015828a3d4e79ad3491fc23072d75. Latest consensus state: current_term: 1 leader_uuid: "2dc015828a3d4e79ad3491fc23072d75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } } }
I20260812 00:28:26.221798 10458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:26.222505 10456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2dc015828a3d4e79ad3491fc23072d75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } } }
I20260812 00:28:26.222831 10456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:26.222884 10465 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:26.230422 10465 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:26.241150 10465 catalog_manager.cc:1347] Generated new cluster ID: e27d00552f3c494498b5ff63d83e40a6
I20260812 00:28:26.241298 10465 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:26.254392 10465 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:28:26.256475 10465 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:26.270823 10465 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Generated new TSK 0
I20260812 00:28:26.272056 10465 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:28:26.347575 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42953
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:26.711295 10484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:26.711676 10484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:26.711880 10484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:26.719785 10484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:26.719960 10484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:26.720153 10484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:26.731010 10484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:26.732602 10484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:26.734066 10484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:26.748637 10493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:26.748685 10495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:26.748713 10492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:26.750205 10484 server_base.cc:1034] running on GCE node
I20260812 00:28:26.750984 10484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:26.752146 10484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:26.753518 10484 hybrid_clock.cc:648] HybridClock initialized: now 1786494506753430 us; error 49 us; skew 500 ppm
I20260812 00:28:26.753916 10484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:26 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494506, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:26.758430 10484 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:28:26.760330 10484 webserver.cc:460] Webserver started at http://127.29.190.129:35395/ using document root <none> and password file <none>
I20260812 00:28:26.761081 10484 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:26.761238 10484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:26.761634 10484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:26.764816 10484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "ec14597e4c4942a68b0ff3a612054279"
format_stamp: "Formatted at 2026-08-12 00:28:26 on dist-test-slave-c12x"
server_key: "80b13b8512acd83bfeca83aa8fe4ca0c"
server_key_iv: "f4c49ee909ba82f4f34c2f298a810a7f"
server_key_version: "encryptionkey@0"
I20260812 00:28:26.765645 10484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "ec14597e4c4942a68b0ff3a612054279"
format_stamp: "Formatted at 2026-08-12 00:28:26 on dist-test-slave-c12x"
server_key: "80b13b8512acd83bfeca83aa8fe4ca0c"
server_key_iv: "f4c49ee909ba82f4f34c2f298a810a7f"
server_key_version: "encryptionkey@0"
I20260812 00:28:26.771294 10484 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:28:26.775007 10504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:26.776465 10484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:26.776675 10484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "ec14597e4c4942a68b0ff3a612054279"
format_stamp: "Formatted at 2026-08-12 00:28:26 on dist-test-slave-c12x"
server_key: "80b13b8512acd83bfeca83aa8fe4ca0c"
server_key_iv: "f4c49ee909ba82f4f34c2f298a810a7f"
server_key_version: "encryptionkey@0"
I20260812 00:28:26.776901 10484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:26.793953 10484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:26.799000 10484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:26.799324 10484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:26.800410 10484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:26.801921 10484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:26.802033 10484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:26.802188 10484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:26.802263 10484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:26.849071 10484 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:32891
I20260812 00:28:26.849160 10670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:32891 every 8 connection(s)
I20260812 00:28:26.851044 10484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:26.858685 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 10484
I20260812 00:28:26.858925 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:28:26.859755 30458 external_mini_cluster.cc:1428] Setting key aa9b11af3886f211d4e0a980a5cee026
Aug 12 00:28:26 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494506, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:26.874886 10673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:26.854225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:33835 (local address 127.29.190.190:42953)
0812 00:28:26.854715 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:26.854720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:26.855856 (+ 1136us) server_negotiation.cc:407] Connection header received
0812 00:28:26.857739 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:26.857747 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:26.857844 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:26.857956 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:26.860397 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:26.861311 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:26.863126 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:26.863863 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:26.863991 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:26.868535 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:26.868546 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:26.868549 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:26.868584 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:26.871374 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:26.872378 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:26.872384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:26.872388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:26.872528 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:26.873009 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:26.873013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:26.873015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:26.873292 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:26.873457 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:26.874249 (+ 792us) server_negotiation.cc:299] Negotiation successful
0812 00:28:26.874498 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":221,"threads_started":1}
I20260812 00:28:26.876107 10674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:26.854812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:33835)
0812 00:28:26.855693 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:26.855745 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:26.857458 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:26.858279 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:26.858291 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:26.859218 (+ 927us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:26.860182 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:26.860216 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:26.861491 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:26.861497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:26.862968 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:26.862982 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:26.864103 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:26.864111 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:26.864362 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:26.865147 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:26.865201 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:26.868278 (+ 3077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:26.871630 (+ 3352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:26.871641 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:26.871661 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:26.872240 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:26.872648 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:26.872654 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:26.872657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:26.872865 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:26.873433 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:26.873442 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:26.873846 (+ 404us) client_negotiation.cc:769] Sending connection context
0812 00:28:26.874131 (+ 285us) client_negotiation.cc:240] Negotiation successful
0812 00:28:26.874736 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":302,"threads_started":1}
I20260812 00:28:26.877912 10671 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42953
I20260812 00:28:26.878232 10671 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:26.878955 10671 heartbeater.cc:511] Master 127.29.190.190:42953 requested a full tablet report, sending...
I20260812 00:28:26.881508 10401 ts_manager.cc:194] Registered new tserver with Master: ec14597e4c4942a68b0ff3a612054279 (127.29.190.129:32891)
I20260812 00:28:26.883131 10401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:33835
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:28:26.925079 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42953
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:27.283046 10682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:27.283341 10682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:27.283553 10682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:27.291092 10682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:27.291214 10682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:27.291476 10682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:27.302127 10682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:27.303766 10682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:27.305151 10682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:27.318936 10689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:27.318897 10692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:27.318974 10690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:27.320226 10682 server_base.cc:1034] running on GCE node
I20260812 00:28:27.320796 10682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:27.321728 10682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:27.323007 10682 hybrid_clock.cc:648] HybridClock initialized: now 1786494507322968 us; error 61 us; skew 500 ppm
I20260812 00:28:27.323390 10682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:27 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494507, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:27.326643 10682 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:28:27.328282 10682 webserver.cc:460] Webserver started at http://127.29.190.130:44141/ using document root <none> and password file <none>
I20260812 00:28:27.328999 10682 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:27.329164 10682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:27.329512 10682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:27.332880 10682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "c100996d6c9c4297b3d53b186d41a459"
format_stamp: "Formatted at 2026-08-12 00:28:27 on dist-test-slave-c12x"
server_key: "f8a99ed701a566efccd72f9a54483162"
server_key_iv: "d820ded9352b08f126d7eb5b51661508"
server_key_version: "encryptionkey@0"
I20260812 00:28:27.333724 10682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "c100996d6c9c4297b3d53b186d41a459"
format_stamp: "Formatted at 2026-08-12 00:28:27 on dist-test-slave-c12x"
server_key: "f8a99ed701a566efccd72f9a54483162"
server_key_iv: "d820ded9352b08f126d7eb5b51661508"
server_key_version: "encryptionkey@0"
I20260812 00:28:27.339411 10682 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:28:27.343605 10702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:27.345141 10682 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260812 00:28:27.345350 10682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "c100996d6c9c4297b3d53b186d41a459"
format_stamp: "Formatted at 2026-08-12 00:28:27 on dist-test-slave-c12x"
server_key: "f8a99ed701a566efccd72f9a54483162"
server_key_iv: "d820ded9352b08f126d7eb5b51661508"
server_key_version: "encryptionkey@0"
I20260812 00:28:27.345582 10682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:27.385528 10682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:27.390012 10682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:27.390365 10682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:27.391410 10682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:27.392841 10682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:27.392956 10682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:27.393116 10682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:27.393191 10682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:27.428848 10682 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:43481
I20260812 00:28:27.428937 10885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:43481 every 8 connection(s)
I20260812 00:28:27.430215 10682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:27.435714 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 10682
I20260812 00:28:27.435904 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:28:27.436368 30458 external_mini_cluster.cc:1428] Setting key d283b4fd2b8f4cc5e6fd05b07e621b48
Aug 12 00:28:27 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494507, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:27.455080 10888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:27.433396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:50093 (local address 127.29.190.190:42953)
0812 00:28:27.433887 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:27.433894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:27.435028 (+ 1134us) server_negotiation.cc:407] Connection header received
0812 00:28:27.437273 (+ 2245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:27.437281 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:27.437409 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:27.437564 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:27.440120 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:27.441553 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:27.443154 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:27.444067 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:27.444240 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:27.448301 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:27.448312 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:27.448322 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:27.448392 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:27.451801 (+ 3409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:27.452616 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:27.452621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:27.452623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:27.452755 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:27.453236 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:27.453240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:27.453242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:27.453516 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:27.453688 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:27.454423 (+ 735us) server_negotiation.cc:299] Negotiation successful
0812 00:28:27.454685 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":226,"threads_started":1}
I20260812 00:28:27.456162 10889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:27.434053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:50093)
0812 00:28:27.434862 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:27.434902 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:27.436833 (+ 1931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:27.438564 (+ 1731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:27.438577 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:27.439180 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:27.439909 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:27.439929 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:27.441730 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:27.441734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:27.442980 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:27.442995 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:27.444331 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:27.444336 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:27.444593 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:27.445357 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:27.445380 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:27.448008 (+ 2628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:27.451965 (+ 3957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:27.451975 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:27.451992 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:27.452455 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:27.452877 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:27.452882 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:27.452886 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:27.453099 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:27.453670 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:27.453678 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:27.454042 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 00:28:27.454325 (+ 283us) client_negotiation.cc:240] Negotiation successful
0812 00:28:27.454894 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":342,"threads_started":1}
I20260812 00:28:27.457861 10886 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42953
I20260812 00:28:27.458205 10886 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:27.458981 10886 heartbeater.cc:511] Master 127.29.190.190:42953 requested a full tablet report, sending...
I20260812 00:28:27.460599 10401 ts_manager.cc:194] Registered new tserver with Master: c100996d6c9c4297b3d53b186d41a459 (127.29.190.130:43481)
I20260812 00:28:27.461447 10401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:50093
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:28:27.498968 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42953
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:28:27.886529 10671 heartbeater.cc:503] Master 127.29.190.190:42953 was elected leader, sending a full tablet report...
W20260812 00:28:27.889181 10892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:27.889463 10892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:27.889688 10892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:27.897197 10892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:27.897318 10892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:27.897498 10892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:27.908066 10892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:27.909719 10892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:27.911167 10892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:27.925093 10902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:27.925179 10907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:27.925171 10903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:27.926759 10892 server_base.cc:1034] running on GCE node
I20260812 00:28:27.927542 10892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:27.928651 10892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:27.929875 10892 hybrid_clock.cc:648] HybridClock initialized: now 1786494507929824 us; error 48 us; skew 500 ppm
I20260812 00:28:27.930222 10892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:27 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494507, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:27.934123 10892 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:28:27.936018 10892 webserver.cc:460] Webserver started at http://127.29.190.131:34289/ using document root <none> and password file <none>
I20260812 00:28:27.936896 10892 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:27.937067 10892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:27.937438 10892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:27.940960 10892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "0db3bfd8d668441e87e25fe8641afee3"
format_stamp: "Formatted at 2026-08-12 00:28:27 on dist-test-slave-c12x"
server_key: "96d74f6539e314dcd5e7c85550361ad7"
server_key_iv: "f5cc24464c0b5356ef20d46bee5e8210"
server_key_version: "encryptionkey@0"
I20260812 00:28:27.941872 10892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "0db3bfd8d668441e87e25fe8641afee3"
format_stamp: "Formatted at 2026-08-12 00:28:27 on dist-test-slave-c12x"
server_key: "96d74f6539e314dcd5e7c85550361ad7"
server_key_iv: "f5cc24464c0b5356ef20d46bee5e8210"
server_key_version: "encryptionkey@0"
I20260812 00:28:27.948313 10892 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260812 00:28:27.952621 10916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:27.954209 10892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260812 00:28:27.954424 10892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "0db3bfd8d668441e87e25fe8641afee3"
format_stamp: "Formatted at 2026-08-12 00:28:27 on dist-test-slave-c12x"
server_key: "96d74f6539e314dcd5e7c85550361ad7"
server_key_iv: "f5cc24464c0b5356ef20d46bee5e8210"
server_key_version: "encryptionkey@0"
I20260812 00:28:27.954669 10892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:27.978856 10892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:27.984150 10892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:27.984495 10892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:27.985540 10892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:27.986994 10892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:27.987099 10892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:27.987253 10892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:27.987329 10892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:28.024219 10892 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:39435
I20260812 00:28:28.024324 11083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:39435 every 8 connection(s)
I20260812 00:28:28.025637 10892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:28.029134 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 10892
I20260812 00:28:28.029348 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:28:28.030067 30458 external_mini_cluster.cc:1428] Setting key bcfd654f13c93ef6ffcde27f7a1c30fd
Aug 12 00:28:28 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494507, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:28.049502 11086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:28.028661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:42929 (local address 127.29.190.190:42953)
0812 00:28:28.029201 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:28.029206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:28.030765 (+ 1559us) server_negotiation.cc:407] Connection header received
0812 00:28:28.033466 (+ 2701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:28.033472 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:28.033609 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:28.033742 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:28.035540 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.036419 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.038227 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.038681 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.038838 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:28.042858 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:28.042864 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:28.042868 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:28.042910 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:28.046049 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:28.046898 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:28.046908 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:28.046911 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:28.047052 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:28.047592 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:28.047596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:28.047598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:28.047897 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:28.048068 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:28.048825 (+ 757us) server_negotiation.cc:299] Negotiation successful
0812 00:28:28.049057 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":283,"threads_started":1}
I20260812 00:28:28.050498 11087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:28.029549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:42929)
0812 00:28:28.030524 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:28.030580 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:28.033157 (+ 2577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:28.034027 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:28.034036 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:28.034624 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:28.035312 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:28.035332 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.036601 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.036607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:28.038047 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:28.038062 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.038958 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.038968 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:28.039236 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:28.040029 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:28.040055 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:28.042592 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:28.046229 (+ 3637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:28.046240 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:28.046266 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:28.046749 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:28.047175 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:28.047181 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:28.047184 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:28.047398 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:28.048050 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:28.048058 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:28.048436 (+ 378us) client_negotiation.cc:769] Sending connection context
0812 00:28:28.048726 (+ 290us) client_negotiation.cc:240] Negotiation successful
0812 00:28:28.049321 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":383,"threads_started":1}
I20260812 00:28:28.052153 11084 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42953
I20260812 00:28:28.052498 11084 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:28.053265 11084 heartbeater.cc:511] Master 127.29.190.190:42953 requested a full tablet report, sending...
I20260812 00:28:28.054919 10401 ts_manager.cc:194] Registered new tserver with Master: 0db3bfd8d668441e87e25fe8641afee3 (127.29.190.131:39435)
I20260812 00:28:28.055907 10401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:42929
I20260812 00:28:28.058945 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab.
Entry for principal oryx/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab.
WARNING: no policy specified for oryx/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab.
Entry for principal oryx/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab.
WARNING: no policy specified for oryx/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab.
Entry for principal oryx/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab.
I20260812 00:28:28.238385 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 10484
Aug 12 00:28:28 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:28:28.257202 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:28.239842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46184 (local address 127.29.190.129:32891)
0812 00:28:28.240511 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:28.240519 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:28.241088 (+ 569us) server_negotiation.cc:407] Connection header received
0812 00:28:28.241238 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:28.241246 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:28.241485 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:28.241644 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:28.243015 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.244170 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.245546 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.246169 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.246292 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:28.251038 (+ 4746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:28.251054 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:28.251070 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:28.251115 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:28.254283 (+ 3168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:28.255076 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:28.255084 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:28.255087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:28.255230 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:28.255701 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:28.255705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:28.255707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:28.256090 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:28.256333 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:28.256679 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 00:28:28.256902 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":318,"threads_started":1}
I20260812 00:28:28.258759 10663 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:28.344553 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 10484
I20260812 00:28:28.368466 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 10682
Aug 12 00:28:28 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:28:28.386232 11101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:28.369523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38214 (local address 127.29.190.130:43481)
0812 00:28:28.370107 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:28.370114 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:28.370141 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:28:28.370202 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:28.370209 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:28.370417 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:28.370562 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:28.372179 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.373200 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.374624 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.375224 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.375330 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:28.380298 (+ 4968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:28.380311 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:28.380326 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:28.380370 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:28.383328 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:28.384097 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:28.384104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:28.384106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:28.384227 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:28.384646 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:28.384649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:28.384651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:28.384993 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:28.385243 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:28.385588 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 00:28:28.385790 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":284,"threads_started":1}
I20260812 00:28:28.387707 10874 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:28.470790 10886 heartbeater.cc:503] Master 127.29.190.190:42953 was elected leader, sending a full tablet report...
I20260812 00:28:28.472293 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 10682
W20260812 00:28:28.498705 10381 connection.cc:535] server connection from 127.29.190.130:50093 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:28:28.499018 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 10892
Aug 12 00:28:28 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:28:28.516989 11105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:28.500212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59082 (local address 127.29.190.131:39435)
0812 00:28:28.500861 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:28.500872 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:28.500916 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:28:28.501000 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:28.501011 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:28.501308 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:28.501447 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:28.502764 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.503856 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.505126 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:28.505703 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:28.505803 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:28.510775 (+ 4972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:28.510788 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:28.510804 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:28.510846 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:28.514020 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:28.514798 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:28.514805 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:28.514808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:28.514957 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:28.515370 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:28.515373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:28.515403 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:28.515847 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:28.516080 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:28.516463 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 00:28:28.516680 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":289,"threads_started":1}
I20260812 00:28:28.518558 11079 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:28.602020 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 10892
I20260812 00:28:28.624854 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 10354
I20260812 00:28:28.626083 10440 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:28.736009 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 10354
I20260812 00:28:28.770458 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42953
--webserver_interface=127.29.190.190
--webserver_port=44771
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:42953
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:29.128620 11109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:29.128940 11109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:29.129048 11109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:29.137205 11109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:29.137338 11109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:29.137387 11109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:29.137445 11109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:29.137490 11109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:29.147873 11109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:42953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=44771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:29.149339 11109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:29.150708 11109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:29.163345 11118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:29.163388 11115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:29.164220 11120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:29.164197 11109 server_base.cc:1034] running on GCE node
I20260812 00:28:29.165148 11109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:29.166688 11109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:29.167917 11109 hybrid_clock.cc:648] HybridClock initialized: now 1786494509167850 us; error 62 us; skew 500 ppm
I20260812 00:28:29.168286 11109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:29 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494509, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:29.175277 11109 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:28:29.177124 11109 webserver.cc:460] Webserver started at http://127.29.190.190:44771/ using document root <none> and password file <none>
I20260812 00:28:29.177927 11109 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:29.178109 11109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:29.184296 11109 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:28:29.187918 11129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:29.189626 11109 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:28:29.189845 11109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "2dc015828a3d4e79ad3491fc23072d75"
format_stamp: "Formatted at 2026-08-12 00:28:26 on dist-test-slave-c12x"
server_key: "f9366275f71f9164f237fbcaac1dc1c9"
server_key_iv: "85e746c74fb80e196efd36642c7caa59"
server_key_version: "encryptionkey@0"
I20260812 00:28:29.191016 11109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:29.210954 11109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:29.215972 11109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:29.216405 11109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:29.236963 11109 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:42953
I20260812 00:28:29.236981 11201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:42953 every 8 connection(s)
I20260812 00:28:29.238624 11109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:28:29.240643 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 11109
I20260812 00:28:29.241781 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:32891
--local_ip_for_outbound_sockets=127.29.190.129
--tserver_master_addrs=127.29.190.190:42953
--webserver_port=35395
--webserver_interface=127.29.190.129
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.190.129
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:28:29.250320 11202 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:28:29.255085 11202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Bootstrap starting.
I20260812 00:28:29.275545 11202 log.cc:824] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:29.285094 11202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:28:29.285673 11202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Bootstrap complete.
I20260812 00:28:29.295288 11202 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } }
I20260812 00:28:29.296387 11202 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc015828a3d4e79ad3491fc23072d75, State: Initialized, Role: FOLLOWER
I20260812 00:28:29.297026 11202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } }
I20260812 00:28:29.297291 11202 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:28:29.297423 11202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:28:29.297746 11202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:28:29.301965 11202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } }
I20260812 00:28:29.302510 11202 leader_election.cc:302] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dc015828a3d4e79ad3491fc23072d75; no voters:
I20260812 00:28:29.303191 11202 leader_election.cc:288] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:28:29.303349 11209 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:28:29.304936 11209 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [term 2 LEADER]: Becoming Leader. State: Replica: 2dc015828a3d4e79ad3491fc23072d75, State: Running, Role: LEADER
I20260812 00:28:29.305749 11202 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:29.305675 11209 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } }
I20260812 00:28:29.308894 11210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2dc015828a3d4e79ad3491fc23072d75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } } }
I20260812 00:28:29.309378 11210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:29.308861 11211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dc015828a3d4e79ad3491fc23072d75. Latest consensus state: current_term: 2 leader_uuid: "2dc015828a3d4e79ad3491fc23072d75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dc015828a3d4e79ad3491fc23072d75" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42953 } } }
I20260812 00:28:29.309798 11211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:29.322408 11215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:29.329771 11215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:29.331488 11215 catalog_manager.cc:1259] Loaded cluster ID: e27d00552f3c494498b5ff63d83e40a6
I20260812 00:28:29.331693 11215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:29.336573 11215 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:29.338583 11215 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2dc015828a3d4e79ad3491fc23072d75: Loaded TSK: 0
I20260812 00:28:29.340663 11215 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:28:29.645664 11205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:29.645982 11205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:29.646135 11205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:29.653753 11205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:29.653882 11205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:29.654062 11205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:29.664587 11205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.129.keytab
--principal=oryx/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:32891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=35395
--tserver_master_addrs=127.29.190.190:42953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:29.666081 11205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:29.667564 11205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:29.683985 11242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:29.684156 11243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:29.684702 11245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:29.685648 11205 server_base.cc:1034] running on GCE node
I20260812 00:28:29.686529 11205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:29.687932 11205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:29.689216 11205 hybrid_clock.cc:648] HybridClock initialized: now 1786494509689131 us; error 63 us; skew 500 ppm
I20260812 00:28:29.689724 11205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:29 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494509, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:29.693924 11205 init.cc:377] Logged in from keytab as oryx/127.29.190.129@KRBTEST.COM (short username oryx)
I20260812 00:28:29.695996 11205 webserver.cc:460] Webserver started at http://127.29.190.129:35395/ using document root <none> and password file <none>
I20260812 00:28:29.696820 11205 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:29.696998 11205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:29.703287 11205 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.006s
I20260812 00:28:29.706488 11254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:29.708184 11205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:28:29.708384 11205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "ec14597e4c4942a68b0ff3a612054279"
format_stamp: "Formatted at 2026-08-12 00:28:26 on dist-test-slave-c12x"
server_key: "80b13b8512acd83bfeca83aa8fe4ca0c"
server_key_iv: "f4c49ee909ba82f4f34c2f298a810a7f"
server_key_version: "encryptionkey@0"
I20260812 00:28:29.709471 11205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:29.727377 11205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:29.732263 11205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:29.732625 11205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:29.733788 11205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:29.735328 11205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:29.735500 11205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:29.735656 11205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:29.735765 11205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:29.772886 11205 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:32891
I20260812 00:28:29.773084 11413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:32891 every 8 connection(s)
I20260812 00:28:29.774588 11205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:29.784758 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 11205
I20260812 00:28:29.785566 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:43481
--local_ip_for_outbound_sockets=127.29.190.130
--tserver_master_addrs=127.29.190.190:42953
--webserver_port=44141
--webserver_interface=127.29.190.130
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.190.130
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:28:29 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:29 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:29.795279 11418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:29.777995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:51867)
0812 00:28:29.778877 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:29.778935 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:29.780809 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:29.782455 (+ 1646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:29.782467 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:29.783047 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:29.783734 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:29.783757 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.786261 (+ 2504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.786266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:29.787697 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:29.787712 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.789250 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.789255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:29.789461 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:29.790214 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:29.790238 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:29.794043 (+ 3805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":375,"threads_started":1}
W20260812 00:28:29.795742 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:29.777992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51867 (local address 127.29.190.190:42953)
0812 00:28:29.778697 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:29.778710 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:29.779075 (+ 365us) server_negotiation.cc:407] Connection header received
0812 00:28:29.781467 (+ 2392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:29.781484 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:29.781919 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:29.782256 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:29.783966 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.786021 (+ 2055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.787863 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.788984 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.789238 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:29.794540 (+ 5302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:51867: BlockingRecv error: recv got EOF from 127.29.190.129:51867 (error 108)
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":270,"threads_started":1}
W20260812 00:28:29.796340 11414 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:42953 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.190.190:42953: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Aug 12 00:28:29 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:29 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:29.805948 11418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:29.797104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:40571)
0812 00:28:29.797307 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:29.797329 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:29.797439 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:29.797803 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:29.797806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:29.798135 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:29.798281 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:29.798289 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.799971 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.799976 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:29.800901 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:29.800915 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.801967 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.801971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:29.802109 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:29.802772 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:29.802790 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:29.805736 (+ 2946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 00:28:29.806375 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:29.797261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:40571 (local address 127.29.190.190:42953)
0812 00:28:29.797450 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:29.797458 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:29.797491 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:28:29.797560 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:29.797568 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:29.797660 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:29.797770 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:29.798475 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.799819 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.801067 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.801809 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.801950 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:29.806036 (+ 4086us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:40571: BlockingRecv error: recv got EOF from 127.29.190.129:40571 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 00:28:29 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:29 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:29.815315 11418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:29.806751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:38021)
0812 00:28:29.806911 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:29.806933 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:29.807028 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:29.807587 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:29.807599 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:29.807927 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:29.808076 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:29.808086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.809390 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.809396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:29.810336 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:29.810347 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.811055 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.811064 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:29.811282 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:29.811930 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:29.811947 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:29.814962 (+ 3015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 00:28:29.815459 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:29.807093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:38021 (local address 127.29.190.190:42953)
0812 00:28:29.807271 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:29.807276 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:29.807290 (+ 14us) server_negotiation.cc:407] Connection header received
0812 00:28:29.807334 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:29.807338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:29.807408 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:29.807561 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:29.808225 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.809227 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.810480 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:29.810887 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:29.811018 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:29.815188 (+ 4170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:38021: BlockingRecv error: recv got EOF from 127.29.190.129:38021 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260812 00:28:29.815913 11414 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:28:30.147250 11419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:30.147698 11419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:30.147897 11419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:30.156141 11419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:30.156306 11419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:30.156499 11419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:30.166887 11419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.130.keytab
--principal=oryx/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:43481
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=44141
--tserver_master_addrs=127.29.190.190:42953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:30.168408 11419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:30.169762 11419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:30.183487 11425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:30.183677 11426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:30.183632 11428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:30.185052 11419 server_base.cc:1034] running on GCE node
I20260812 00:28:30.185729 11419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:30.186838 11419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:30.188090 11419 hybrid_clock.cc:648] HybridClock initialized: now 1786494510188037 us; error 55 us; skew 500 ppm
I20260812 00:28:30.188448 11419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494510, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:30.191910 11419 init.cc:377] Logged in from keytab as oryx/127.29.190.130@KRBTEST.COM (short username oryx)
I20260812 00:28:30.193536 11419 webserver.cc:460] Webserver started at http://127.29.190.130:44141/ using document root <none> and password file <none>
I20260812 00:28:30.194240 11419 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:30.194370 11419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:30.200378 11419 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:28:30.203214 11435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:30.204777 11419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:28:30.204939 11419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "c100996d6c9c4297b3d53b186d41a459"
format_stamp: "Formatted at 2026-08-12 00:28:27 on dist-test-slave-c12x"
server_key: "f8a99ed701a566efccd72f9a54483162"
server_key_iv: "d820ded9352b08f126d7eb5b51661508"
server_key_version: "encryptionkey@0"
I20260812 00:28:30.205930 11419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:30.242220 11419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:30.248183 11419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:30.248534 11419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:30.249836 11419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:30.251716 11419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:30.251809 11419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:30.251890 11419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:30.251950 11419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:30.288013 11419 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:43481
I20260812 00:28:30.288163 11613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:43481 every 8 connection(s)
I20260812 00:28:30.289589 11419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:30.298512 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 11419
I20260812 00:28:30.299181 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:39435
--local_ip_for_outbound_sockets=127.29.190.131
--tserver_master_addrs=127.29.190.190:42953
--webserver_port=34289
--webserver_interface=127.29.190.131
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.190.131
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:28:30.307065 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:30.292378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:56159 (local address 127.29.190.190:42953)
0812 00:28:30.292558 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:30.292563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:30.293882 (+ 1319us) server_negotiation.cc:407] Connection header received
0812 00:28:30.295992 (+ 2110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:30.295998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:30.296121 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:30.296232 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:30.297837 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.298574 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.300361 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.300826 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.300966 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.306781 (+ 5815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:56159: BlockingRecv error: recv got EOF from 127.29.190.130:56159 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:28:30.308018 11616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:30.292965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:56159)
0812 00:28:30.293704 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:30.293742 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:30.295706 (+ 1964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:30.296535 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:30.296544 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:30.297072 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:30.297653 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.297671 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.298761 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.298765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.300222 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.300236 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.301063 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.301072 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.301313 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.302025 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:30.302050 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:30.306497 (+ 4447us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":289,"threads_started":1}
W20260812 00:28:30.308768 11614 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:42953 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.190.190:42953: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:30.319335 11616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:30.309479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:55109)
0812 00:28:30.309694 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:30.309714 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:30.309835 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:30.310199 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:30.310204 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:30.310730 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:30.310963 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.310978 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.312220 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.312229 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.313983 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.314003 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.314818 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.314824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.315040 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.315791 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:30.315829 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:30.319022 (+ 3193us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":77}
W20260812 00:28:30.319550 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:30.309666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:55109 (local address 127.29.190.190:42953)
0812 00:28:30.309852 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:30.309858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:30.309880 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:28:30.309949 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:30.309954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:30.310059 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:30.310165 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:30.311159 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.312051 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.314151 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.314613 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.314801 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.319257 (+ 4456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:55109: BlockingRecv error: recv got EOF from 127.29.190.130:55109 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:28:30.330699 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:30.320438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:54311 (local address 127.29.190.190:42953)
0812 00:28:30.320576 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:30.320580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:30.320596 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:28:30.320747 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:30.320750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:30.320809 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:30.320889 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:30.321789 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.322625 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.324868 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.325263 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.325361 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.330533 (+ 5172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:54311: BlockingRecv error: recv got EOF from 127.29.190.130:54311 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 00:28:30.330698 11616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:30.320283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:54311)
0812 00:28:30.320486 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:30.320507 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:30.320617 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:30.320947 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:30.320954 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:30.321405 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:30.321634 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.321649 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.322772 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.322780 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.324715 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.324735 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.325425 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.325433 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.325667 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.326331 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:30.326362 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:30.330307 (+ 3945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 00:28:30.331085 11614 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:28:30.659850 11620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:30.660169 11620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:30.660269 11620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:30.667902 11620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:30.668035 11620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:30.668149 11620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:30.678090 11620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/krb5kdc/oryx_127.29.190.131.keytab
--principal=oryx/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:39435
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=34289
--tserver_master_addrs=127.29.190.190:42953
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:30.679477 11620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:30.680883 11620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:30.695113 11632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:30.695492 11631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:30.695075 11634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:30.696755 11620 server_base.cc:1034] running on GCE node
I20260812 00:28:30.697446 11620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:30.698524 11620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:30.699743 11620 hybrid_clock.cc:648] HybridClock initialized: now 1786494510699696 us; error 38 us; skew 500 ppm
I20260812 00:28:30.700059 11620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494510, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:30.703583 11620 init.cc:377] Logged in from keytab as oryx/127.29.190.131@KRBTEST.COM (short username oryx)
I20260812 00:28:30.705243 11620 webserver.cc:460] Webserver started at http://127.29.190.131:34289/ using document root <none> and password file <none>
I20260812 00:28:30.706063 11620 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:30.706193 11620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:30.712426 11620 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:28:30.715842 11644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:30.717350 11620 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:28:30.717517 11620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "0db3bfd8d668441e87e25fe8641afee3"
format_stamp: "Formatted at 2026-08-12 00:28:27 on dist-test-slave-c12x"
server_key: "96d74f6539e314dcd5e7c85550361ad7"
server_key_iv: "f5cc24464c0b5356ef20d46bee5e8210"
server_key_version: "encryptionkey@0"
I20260812 00:28:30.718600 11620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:30.753998 11620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:30.758890 11620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:30.759147 11620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:30.760257 11620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:30.762195 11620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:30.762297 11620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:30.762382 11620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:30.762439 11620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:30.813431 11620 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:39435
I20260812 00:28:30.813530 11817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:39435 every 8 connection(s)
I20260812 00:28:30.815200 11620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:30.821884 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 11620
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:30.829967 11822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:30.816669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:43211)
0812 00:28:30.817217 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:30.817242 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:30.817383 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:30.817824 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:30.817831 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:30.818524 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:30.818808 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.818823 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.820326 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.820334 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.821910 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.821929 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.823378 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.823398 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.823605 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.826146 (+ 2541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:30.826165 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:30.829563 (+ 3398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":325,"threads_started":1}
W20260812 00:28:30.830168 11417 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:30.817148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:43211 (local address 127.29.190.190:42953)
0812 00:28:30.817359 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:30.817368 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:30.817397 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:28:30.817507 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:30.817512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:30.817612 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:30.817759 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:30.819027 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.820142 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.822089 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.822790 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.822937 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.829845 (+ 6908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:43211: BlockingRecv error: recv got EOF from 127.29.190.129:43211 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:28:30.836562 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:30.818525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:50823 (local address 127.29.190.190:42953)
0812 00:28:30.819072 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:30.819077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:30.820241 (+ 1164us) server_negotiation.cc:407] Connection header received
0812 00:28:30.823055 (+ 2814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:30.823059 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:30.823138 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:30.823216 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:30.825892 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.827316 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.829632 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.830329 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.830435 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.836170 (+ 5735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:50823: BlockingRecv error: recv got EOF from 127.29.190.131:50823 (error 108)
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":258,"threads_started":1}
I20260812 00:28:30.836958 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:30.819183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:50823)
0812 00:28:30.820046 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:30.820106 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:30.822695 (+ 2589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:30.823901 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:30.823916 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:30.824720 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:30.825597 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.825619 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.827556 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.827564 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.829453 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.829470 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.830798 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.830805 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.831120 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.831928 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:30.831952 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:30.835823 (+ 3871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":355,"threads_started":1}
W20260812 00:28:30.837688 11819 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:42953 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.190.190:42953: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
I20260812 00:28:30.843154 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:30.822913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51706 (local address 127.29.190.190:42953)
0812 00:28:30.825079 (+ 2166us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:30.825084 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:30.825101 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:28:30.825156 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:30.825161 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:30.825221 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:30.825342 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:30.827733 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.828914 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.831093 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.831625 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.831772 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.834692 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:30.834702 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:30.834721 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:30.834763 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:30.839058 (+ 4295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:30.839982 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:30.839989 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:30.839996 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:30.840187 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:30.840693 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:30.840698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:30.840701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:30.841395 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:30.841754 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:30.842271 (+ 517us) server_negotiation.cc:299] Negotiation successful
0812 00:28:30.842706 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2043,"thread_start_us":1867,"threads_started":1}
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:30.848326 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:30.838330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:57141)
0812 00:28:30.838624 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:30.838645 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:30.838761 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:30.839101 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:30.839109 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:30.839517 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:30.839676 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.839684 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.841069 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.841075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.842686 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.842703 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.843616 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.843623 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.843829 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.844481 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:30.844506 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:30.848109 (+ 3603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159}
W20260812 00:28:30.848610 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:30.838524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:57141 (local address 127.29.190.190:42953)
0812 00:28:30.838766 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:30.838771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:30.838791 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:28:30.838877 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:30.838881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:30.838946 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:30.839040 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:30.839830 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.840891 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.842849 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.843404 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.843595 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.848303 (+ 4708us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:57141: BlockingRecv error: recv got EOF from 127.29.190.131:57141 (error 108)
Metrics: {"server-negotiator.queue_time_us":132}
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:30 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:30.857235 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:30.849084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:56129)
0812 00:28:30.849264 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:30.849286 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:30.849395 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:30.849755 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:30.849760 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:30.850084 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:30.850235 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.850243 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.851263 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.851268 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.852294 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:30.852305 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.853088 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.853095 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:30.853274 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.853883 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:30.853900 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:30.856876 (+ 2976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 00:28:30.857383 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:30.849199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:56129 (local address 127.29.190.190:42953)
0812 00:28:30.849387 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:30.849393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:30.849411 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:28:30.849503 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:30.849508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:30.849619 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:30.849726 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:30.850377 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.851115 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.852449 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:30.852923 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:30.853057 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:30.857120 (+ 4063us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:56129: BlockingRecv error: recv got EOF from 127.29.190.131:56129 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 00:28:30.857700 11819 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 00:28:31 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:31 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:31.341610 11827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:31.331923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:35787)
0812 00:28:31.332540 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:31.332563 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:31.332738 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:31.333242 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:31.333247 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:31.333909 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:31.334114 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:31.334125 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.335201 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.335205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:31.336464 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:31.336481 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.337353 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.337358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:31.337661 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:31.338307 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:31.338325 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:31.341369 (+ 3044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":284,"threads_started":1}
W20260812 00:28:31.341919 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:31.331986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:35787 (local address 127.29.190.190:42953)
0812 00:28:31.332224 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:31.332234 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:31.332666 (+ 432us) server_negotiation.cc:407] Connection header received
0812 00:28:31.332893 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:31.332899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:31.333010 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:31.333131 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:31.334288 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.335058 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.336645 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.337137 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.337252 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:31.341643 (+ 4391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:35787: BlockingRecv error: recv got EOF from 127.29.190.130:35787 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 00:28:31 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:31 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:31.841284 11828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:31.831349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:38251)
0812 00:28:31.832068 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:31.832086 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:31.832249 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:31.832783 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:31.832788 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:31.833311 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:31.833627 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:31.833645 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.834830 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.834836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:31.835928 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:31.835944 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.836873 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.836878 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:31.837020 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:31.837769 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:31.837789 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:31.840989 (+ 3200us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":437,"threads_started":1}
W20260812 00:28:31.841606 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:31.831402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:38251 (local address 127.29.190.190:42953)
0812 00:28:31.831632 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:31.831639 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:31.832179 (+ 540us) server_negotiation.cc:407] Connection header received
0812 00:28:31.832398 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:31.832405 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:31.832582 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:31.832700 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:31.833829 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.834661 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.836116 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.836687 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.836809 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:31.841282 (+ 4473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:38251: BlockingRecv error: recv got EOF from 127.29.190.129:38251 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 12 00:28:31 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:31 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:31.867852 11829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:31.858395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:55085)
0812 00:28:31.859029 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:31.859052 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:31.859183 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:31.859654 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:31.859659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:31.860214 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:31.860437 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:31.860447 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.861518 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.861523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:31.862636 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:31.862649 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.863524 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.863529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:31.863671 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:31.864326 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:31.864345 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:31.867593 (+ 3248us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":323,"threads_started":1}
W20260812 00:28:31.868167 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:31.858523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:55085 (local address 127.29.190.190:42953)
0812 00:28:31.858733 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:31.858738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:31.859156 (+ 418us) server_negotiation.cc:407] Connection header received
0812 00:28:31.859296 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:31.859300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:31.859372 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:31.859570 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:31.860605 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.861366 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.862799 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:31.863284 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:31.863406 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:31.867854 (+ 4448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:55085: BlockingRecv error: recv got EOF from 127.29.190.131:55085 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 00:28:32 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:32 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:32.351990 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:32.342543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:33699)
0812 00:28:32.343142 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:32.343160 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:32.343334 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:32.343752 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:32.343757 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:32.344253 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:32.344477 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:32.344489 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.345658 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.345664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:32.346671 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:32.346683 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.347526 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.347532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:32.347711 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:32.348353 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:32.348372 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:32.351713 (+ 3341us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":328,"threads_started":1}
W20260812 00:28:32.352141 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:32.342656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:33699 (local address 127.29.190.190:42953)
0812 00:28:32.342937 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:32.342946 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:32.343260 (+ 314us) server_negotiation.cc:407] Connection header received
0812 00:28:32.343508 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:32.343516 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:32.343598 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:32.343713 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:32.344646 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.345491 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.346832 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.347319 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.347491 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:32.351916 (+ 4425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:33699: BlockingRecv error: recv got EOF from 127.29.190.130:33699 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 00:28:32 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:32 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:32.851586 11831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:32.842377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:60565)
0812 00:28:32.843004 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:32.843031 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:32.843209 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:32.843632 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:32.843637 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:32.844050 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:32.844225 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:32.844234 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.845281 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.845289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:32.846206 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:32.846218 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.846983 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.846989 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:32.847170 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:32.847933 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:32.847959 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:32.851268 (+ 3309us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":317,"threads_started":1}
W20260812 00:28:32.851851 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:32.842722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:60565 (local address 127.29.190.190:42953)
0812 00:28:32.842974 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:32.842981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:32.843125 (+ 144us) server_negotiation.cc:407] Connection header received
0812 00:28:32.843348 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:32.843358 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:32.843422 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:32.843591 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:32.844391 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.845142 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.846360 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.846815 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.846957 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:32.851571 (+ 4614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:60565: BlockingRecv error: recv got EOF from 127.29.190.129:60565 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 12 00:28:32 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:32 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:32.878949 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:32.869170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:57869)
0812 00:28:32.869744 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:32.869766 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:32.869905 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:32.870281 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:32.870285 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:32.870700 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:32.870878 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:32.870887 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.872284 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.872289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:32.873502 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:32.873521 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.874428 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.874434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:32.874619 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:32.875405 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:32.875429 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:32.878577 (+ 3148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":326,"threads_started":1}
W20260812 00:28:32.879057 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:32.869256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:57869 (local address 127.29.190.190:42953)
0812 00:28:32.869581 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:32.869588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:32.869892 (+ 304us) server_negotiation.cc:407] Connection header received
0812 00:28:32.870063 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:32.870068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:32.870138 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:32.870231 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:32.871055 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.872094 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.873674 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:32.874238 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:32.874375 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:32.878810 (+ 4435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:57869: BlockingRecv error: recv got EOF from 127.29.190.131:57869 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 00:28:33 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:33 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:33.362743 11834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:33.353159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:42987)
0812 00:28:33.353868 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:33.353890 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:33.354038 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:33.354403 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:33.354406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:33.354770 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:33.354949 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:33.354957 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.356346 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.356350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:33.357628 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:33.357643 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.358478 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.358483 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:33.358639 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:33.359330 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:33.359349 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:33.362423 (+ 3074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":471,"threads_started":1}
W20260812 00:28:33.362949 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:33.353285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:42987 (local address 127.29.190.190:42953)
0812 00:28:33.353539 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:33.353544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:33.354028 (+ 484us) server_negotiation.cc:407] Connection header received
0812 00:28:33.354154 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:33.354159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:33.354230 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:33.354323 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:33.355152 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.356214 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.357807 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.358281 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.358401 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:33.362722 (+ 4321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:42987: BlockingRecv error: recv got EOF from 127.29.190.130:42987 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 00:28:33 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:33 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:33.861331 11835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:33.852567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:42013)
0812 00:28:33.853081 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:33.853099 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:33.853230 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:33.853600 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:33.853604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:33.854011 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:33.854173 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:33.854182 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.855204 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.855208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:33.856325 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:33.856340 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.857062 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.857067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:33.857197 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:33.857881 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:33.857900 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:33.861090 (+ 3190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":273,"threads_started":1}
W20260812 00:28:33.861796 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:33.852742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:42013 (local address 127.29.190.190:42953)
0812 00:28:33.853010 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:33.853017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:33.853182 (+ 165us) server_negotiation.cc:407] Connection header received
0812 00:28:33.853336 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:33.853340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:33.853405 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:33.853503 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:33.854310 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.855067 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.856477 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.856922 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.857027 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:33.861443 (+ 4416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:42013: BlockingRecv error: recv got EOF from 127.29.190.129:42013 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
Aug 12 00:28:33 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:33 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:33.888883 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:33.879958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:35305)
0812 00:28:33.880477 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:33.880502 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:33.880633 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:33.880936 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:33.880939 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:33.881293 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:33.881472 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:33.881481 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.882649 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.882653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:33.883591 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:33.883603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.884369 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.884373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:33.884495 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:33.885173 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:33.885198 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:33.888594 (+ 3396us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":291,"threads_started":1}
W20260812 00:28:33.888971 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:33.880114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:35305 (local address 127.29.190.190:42953)
0812 00:28:33.880316 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:33.880321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:33.880597 (+ 276us) server_negotiation.cc:407] Connection header received
0812 00:28:33.880738 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:33.880742 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:33.880809 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:33.880907 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:33.881646 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.882519 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.883765 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:33.884235 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:33.884352 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:33.888799 (+ 4447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:35305: BlockingRecv error: recv got EOF from 127.29.190.131:35305 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 12 00:28:34 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:34 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:34.378367 11839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:34.364061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:41439)
0812 00:28:34.364635 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:34.364659 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:34.364790 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:34.365160 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:34.365165 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:34.365612 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:34.365782 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:34.365792 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.366921 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.366926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:34.368104 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:34.368117 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.369075 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.369081 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:34.369237 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:34.374766 (+ 5529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:34.374789 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:34.378004 (+ 3215us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":354,"threads_started":1}
W20260812 00:28:34.378551 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:34.364162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:41439 (local address 127.29.190.190:42953)
0812 00:28:34.364342 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:34.364348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:34.364753 (+ 405us) server_negotiation.cc:407] Connection header received
0812 00:28:34.364902 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:34.364906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:34.364973 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:34.365099 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:34.365944 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.366770 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.368273 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.368886 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.369044 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:34.378284 (+ 9240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:41439: BlockingRecv error: recv got EOF from 127.29.190.130:41439 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 00:28:34 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:34 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:34.871702 11840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:34.862540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:34377)
0812 00:28:34.863127 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:34.863144 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:34.863261 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:34.863642 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:34.863645 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:34.864091 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:34.864266 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:34.864275 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.865443 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.865448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:34.866413 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:34.866426 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.867276 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.867281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:34.867476 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:34.868210 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:34.868231 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:34.871327 (+ 3096us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":312,"threads_started":1}
W20260812 00:28:34.871743 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:34.862662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:34377 (local address 127.29.190.190:42953)
0812 00:28:34.862862 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:34.862866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:34.863256 (+ 390us) server_negotiation.cc:407] Connection header received
0812 00:28:34.863393 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:34.863398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:34.863503 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:34.863593 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:34.864464 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.865272 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.866588 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.867103 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.867219 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:34.871563 (+ 4344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:34377: BlockingRecv error: recv got EOF from 127.29.190.129:34377 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 12 00:28:34 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:34 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:34.900125 11842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:34.889975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:56003)
0812 00:28:34.890599 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:34.890620 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:34.890748 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:34.891189 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:34.891193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:34.891656 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:34.891818 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:34.891827 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.893146 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.893154 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:34.894456 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:34.894472 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.895354 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.895363 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:34.895608 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:34.896307 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:34.896326 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:34.899714 (+ 3388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":321,"threads_started":1}
W20260812 00:28:34.900269 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:34.890062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:56003 (local address 127.29.190.190:42953)
0812 00:28:34.890236 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:34.890241 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:34.890713 (+ 472us) server_negotiation.cc:407] Connection header received
0812 00:28:34.890953 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:34.890957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:34.891034 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:34.891148 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:34.891982 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.892911 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.894625 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:34.895144 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:34.895246 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:34.899973 (+ 4727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:56003: BlockingRecv error: recv got EOF from 127.29.190.131:56003 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 00:28:35 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:35 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:35.388561 11843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:35.379338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:51141)
0812 00:28:35.379954 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:35.379973 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:35.380134 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:35.380509 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:35.380514 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:35.380938 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:35.381113 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:35.381123 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.382165 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.382171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:35.383112 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:35.383123 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.383911 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.383917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:35.384099 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:35.384749 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:35.384766 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:35.388185 (+ 3419us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":283,"threads_started":1}
W20260812 00:28:35.388695 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:35.379582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:51141 (local address 127.29.190.190:42953)
0812 00:28:35.379819 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:35.379827 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:35.380057 (+ 230us) server_negotiation.cc:407] Connection header received
0812 00:28:35.380259 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:35.380264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:35.380334 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:35.380449 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:35.381272 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.382019 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.383256 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.383756 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.383886 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:35.388403 (+ 4517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:51141: BlockingRecv error: recv got EOF from 127.29.190.130:51141 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 00:28:35 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:35 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:35.882864 11844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:35.872890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:37245)
0812 00:28:35.873504 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:35.873544 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:35.873725 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:35.874113 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:35.874117 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:35.874561 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:35.874713 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:35.874722 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.876070 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.876075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:35.877118 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:35.877132 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.878548 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.878553 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:35.878687 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:35.879362 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:35.879407 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:35.882488 (+ 3081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":348,"threads_started":1}
W20260812 00:28:35.883018 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:35.873043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:37245 (local address 127.29.190.190:42953)
0812 00:28:35.873308 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:35.873316 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:35.873643 (+ 327us) server_negotiation.cc:407] Connection header received
0812 00:28:35.873873 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:35.873882 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:35.873960 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:35.874080 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:35.874871 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.875870 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.877268 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.878340 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.878467 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:35.882743 (+ 4276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:37245: BlockingRecv error: recv got EOF from 127.29.190.129:37245 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 12 00:28:35 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:35 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:35.910772 11845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:35.901296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:50285)
0812 00:28:35.901955 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:35.901987 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:35.902140 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:35.902551 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:35.902555 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:35.903128 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:35.903312 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:35.903321 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.904725 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.904731 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:35.905701 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:35.905713 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.906560 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.906566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:35.906753 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:35.907392 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:35.907419 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:35.910354 (+ 2935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":349,"threads_started":1}
W20260812 00:28:35.911176 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:35.901392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:50285 (local address 127.29.190.190:42953)
0812 00:28:35.901600 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:35.901609 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:35.902072 (+ 463us) server_negotiation.cc:407] Connection header received
0812 00:28:35.902274 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:35.902279 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:35.902366 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:35.902466 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:35.903502 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.904563 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.905846 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:35.906407 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:35.906542 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:35.910884 (+ 4342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:50285: BlockingRecv error: recv got EOF from 127.29.190.131:50285 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 00:28:36 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:36 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:36.400329 11848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:36.389992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:34099)
0812 00:28:36.390535 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:36.390553 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:36.390683 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:36.391080 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:36.391084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:36.391638 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:36.391809 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:36.391818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.393564 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.393576 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:36.394591 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:36.394609 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.395607 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.395612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:36.395778 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:36.396530 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:36.396550 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:36.400097 (+ 3547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":306,"threads_started":1}
W20260812 00:28:36.400671 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:36.390090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:34099 (local address 127.29.190.190:42953)
0812 00:28:36.390430 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:36.390438 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:36.390665 (+ 227us) server_negotiation.cc:407] Connection header received
0812 00:28:36.390808 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:36.390813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:36.390886 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:36.390979 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:36.392021 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.393373 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.394835 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.395384 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.395582 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:36.400354 (+ 4772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:34099: BlockingRecv error: recv got EOF from 127.29.190.130:34099 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 12 00:28:36 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:36 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 00:28:36.898491 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:36.884082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:49605 (local address 127.29.190.190:42953)
0812 00:28:36.884352 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:36.884358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:36.888027 (+ 3669us) server_negotiation.cc:407] Connection header received
0812 00:28:36.888159 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:36.888163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:36.888257 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:36.888377 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:36.889503 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.890500 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.892249 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.892856 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.893011 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:36.898285 (+ 5274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:49605: BlockingRecv error: recv got EOF from 127.29.190.129:49605 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:28:36.898538 11849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:36.883997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:49605)
0812 00:28:36.887911 (+ 3914us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:36.887929 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:36.888056 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:36.888428 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:36.888436 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:36.889065 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:36.889325 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:36.889337 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.890640 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.890648 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:36.892097 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:36.892113 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.893226 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.893232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:36.893413 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:36.894067 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:36.894097 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:36.898029 (+ 3932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":3777,"thread_start_us":3535,"threads_started":1}
Aug 12 00:28:36 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:36 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:36.923094 11850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:36.911957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:47401)
0812 00:28:36.912513 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:36.912537 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:36.912700 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:36.913328 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:36.913335 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:36.913942 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:36.914216 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:36.914234 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.915760 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.915766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:36.917250 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:36.917263 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.918418 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.918431 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:36.918634 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:36.919363 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:36.919387 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:36.922761 (+ 3374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":311,"threads_started":1}
W20260812 00:28:36.923295 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:36.912086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:47401 (local address 127.29.190.190:42953)
0812 00:28:36.912305 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:36.912314 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:36.912611 (+ 297us) server_negotiation.cc:407] Connection header received
0812 00:28:36.912842 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:36.912850 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:36.912949 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:36.913091 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:36.914386 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.915624 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.917462 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:36.918029 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:36.918181 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:36.922990 (+ 4809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:47401: BlockingRecv error: recv got EOF from 127.29.190.131:47401 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 00:28:37 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:37 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:37.410615 11854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:37.401614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:54823)
0812 00:28:37.402237 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:37.402255 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:37.402416 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:37.402758 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:37.402763 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:37.403239 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:37.403413 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:37.403422 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.404517 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.404522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:37.405435 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:37.405447 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.406238 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.406244 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:37.406416 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:37.407167 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:37.407193 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:37.410267 (+ 3074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":274,"threads_started":1}
W20260812 00:28:37.410787 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:37.401693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:54823 (local address 127.29.190.190:42953)
0812 00:28:37.401977 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:37.401985 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:37.402343 (+ 358us) server_negotiation.cc:407] Connection header received
0812 00:28:37.402555 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:37.402559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:37.402623 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:37.402728 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:37.403609 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.404352 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.405579 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.406081 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.406217 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:37.410506 (+ 4289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:54823: BlockingRecv error: recv got EOF from 127.29.190.130:54823 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 12 00:28:37 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:37 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:37.908774 11858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:37.899631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:34779)
0812 00:28:37.900267 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:37.900285 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:37.900419 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:37.900905 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:37.900908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:37.901331 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:37.901557 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:37.901573 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.902634 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.902639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:37.903669 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:37.903683 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.904683 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.904688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:37.904853 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:37.905580 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:37.905598 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:37.908535 (+ 2937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":345,"threads_started":1}
W20260812 00:28:37.909056 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:37.899678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:34779 (local address 127.29.190.190:42953)
0812 00:28:37.899868 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:37.899873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:37.900393 (+ 520us) server_negotiation.cc:407] Connection header received
0812 00:28:37.900665 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:37.900669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:37.900738 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:37.900832 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:37.901720 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.902478 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.903843 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.904502 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.904627 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:37.908754 (+ 4127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:34779: BlockingRecv error: recv got EOF from 127.29.190.129:34779 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 00:28:37 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:37 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:37.933811 11859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:37.924461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:58037)
0812 00:28:37.925059 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:37.925079 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:37.925192 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:37.925531 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:37.925534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:37.925969 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:37.926138 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:37.926146 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.927256 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.927260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:37.928245 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:37.928257 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.929295 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.929299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:37.929442 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:37.930185 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:37.930214 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:37.933437 (+ 3223us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":281,"threads_started":1}
W20260812 00:28:37.933918 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:37.924628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:58037 (local address 127.29.190.190:42953)
0812 00:28:37.924820 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:37.924824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:37.925165 (+ 341us) server_negotiation.cc:407] Connection header received
0812 00:28:37.925296 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:37.925300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:37.925369 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:37.925508 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:37.926263 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.927110 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.928413 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:37.929114 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:37.929250 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:37.933669 (+ 4419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:58037: BlockingRecv error: recv got EOF from 127.29.190.131:58037 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 00:28:38 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:38 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:38.420753 11860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:38.411673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:49763)
0812 00:28:38.412243 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:38.412260 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:38.412375 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:38.412698 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:38.412701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:38.413092 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:38.413242 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:38.413250 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.414881 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.414887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:38.416233 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:38.416247 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.416993 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.416997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:38.417117 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:38.417709 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:38.417726 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:38.420522 (+ 2796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":298,"threads_started":1}
W20260812 00:28:38.421041 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:38.411765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:49763 (local address 127.29.190.190:42953)
0812 00:28:38.411970 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:38.411975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:38.412336 (+ 361us) server_negotiation.cc:407] Connection header received
0812 00:28:38.412487 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:38.412491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:38.412560 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:38.412658 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:38.413386 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.414718 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.416367 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.416833 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.416933 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:38.420730 (+ 3797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:49763: BlockingRecv error: recv got EOF from 127.29.190.130:49763 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 00:28:38 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:38 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:38.919770 11861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:38.909943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:39141)
0812 00:28:38.910646 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:38.910665 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:38.910798 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:38.911156 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:38.911159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:38.911654 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:38.911848 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:38.911857 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.913099 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.913105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:38.914300 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:38.914319 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.915087 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.915094 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:38.915281 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:38.916066 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:38.916084 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:38.919394 (+ 3310us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":408,"threads_started":1}
W20260812 00:28:38.920012 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:38.909960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:39141 (local address 127.29.190.190:42953)
0812 00:28:38.910222 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:38.910233 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:38.910772 (+ 539us) server_negotiation.cc:407] Connection header received
0812 00:28:38.910943 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:38.910947 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:38.911014 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:38.911104 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:38.912021 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.912934 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.914471 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.914923 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.915064 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:38.919749 (+ 4685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:39141: BlockingRecv error: recv got EOF from 127.29.190.129:39141 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 12 00:28:38 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:38 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:38.945505 11863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:38.935134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:57667)
0812 00:28:38.935929 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:38.935952 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:38.936135 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:38.936616 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:38.936621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:38.937246 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:38.937472 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:38.937483 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.938916 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.938926 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:38.940089 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:38.940102 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.940952 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.940959 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:38.941160 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:38.941812 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:38.941831 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:38.945099 (+ 3268us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":477,"threads_started":1}
W20260812 00:28:38.945709 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:38.935277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:57667 (local address 127.29.190.190:42953)
0812 00:28:38.935695 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:38.935702 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:38.936066 (+ 364us) server_negotiation.cc:407] Connection header received
0812 00:28:38.936291 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:38.936295 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:38.936367 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:38.936567 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:38.937658 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.938754 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.940253 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:38.940734 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:38.940913 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:38.945381 (+ 4468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:57667: BlockingRecv error: recv got EOF from 127.29.190.131:57667 (error 108)
Metrics: {"server-negotiator.queue_time_us":222}
Aug 12 00:28:39 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:39 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:39.435572 11864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:39.421756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:38695)
0812 00:28:39.422402 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:39.422423 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:39.422552 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:39.422973 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:39.422977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:39.423522 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:39.423754 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:39.423765 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.424919 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.424924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:39.425855 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:39.425867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.426692 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.426696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:39.426824 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:39.431887 (+ 5063us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:39.431913 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:39.435134 (+ 3221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":337,"threads_started":1}
W20260812 00:28:39.435648 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:39.421863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:38695 (local address 127.29.190.190:42953)
0812 00:28:39.422108 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:39.422112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:39.422552 (+ 440us) server_negotiation.cc:407] Connection header received
0812 00:28:39.422663 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:39.422667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:39.422734 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:39.422829 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:39.423903 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.424785 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.426019 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.426531 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.426643 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:39.435350 (+ 8707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:38695: BlockingRecv error: recv got EOF from 127.29.190.130:38695 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 00:28:39 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:39 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:39.930365 11865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:39.920870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:52339)
0812 00:28:39.921457 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:39.921473 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:39.921659 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:39.922061 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:39.922066 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:39.922496 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:39.922668 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:39.922678 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.923987 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.923993 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:39.925013 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:39.925025 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.925820 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.925827 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:39.926017 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:39.926782 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:39.926809 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:39.930023 (+ 3214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":328,"threads_started":1}
W20260812 00:28:39.930495 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:39.920962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:52339 (local address 127.29.190.190:42953)
0812 00:28:39.921215 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:39.921224 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:39.921565 (+ 341us) server_negotiation.cc:407] Connection header received
0812 00:28:39.921816 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:39.921820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:39.921914 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:39.922024 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:39.922856 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.923805 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.925164 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.925608 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.925758 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:39.930239 (+ 4481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:52339: BlockingRecv error: recv got EOF from 127.29.190.129:52339 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 12 00:28:39 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:39 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:39.956832 11866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:39.946708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:48987)
0812 00:28:39.947327 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:39.947349 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:39.947545 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:39.947974 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:39.947977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:39.948397 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:39.948596 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:39.948606 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.949729 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.949733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:39.950889 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:39.950903 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.951910 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.951917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:39.952106 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:39.952975 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:39.953010 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:39.956466 (+ 3456us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":335,"threads_started":1}
W20260812 00:28:39.956943 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:39.946814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:48987 (local address 127.29.190.190:42953)
0812 00:28:39.947022 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:39.947028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:39.947490 (+ 462us) server_negotiation.cc:407] Connection header received
0812 00:28:39.947668 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:39.947673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:39.947740 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:39.947834 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:39.948791 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.949563 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.951059 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:39.951724 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:39.951845 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:39.956687 (+ 4842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:48987: BlockingRecv error: recv got EOF from 127.29.190.131:48987 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 00:28:40 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:40 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:40.447101 11867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:40.436814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:35497)
0812 00:28:40.437367 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:40.437385 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:40.437510 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:40.437860 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:40.437863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:40.438267 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:40.438418 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:40.438426 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.440101 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.440107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:40.441264 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:40.441284 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.442135 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.442140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:40.442263 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:40.442966 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:40.442987 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:40.446629 (+ 3642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":341,"threads_started":1}
W20260812 00:28:40.447283 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:40.436902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:35497 (local address 127.29.190.190:42953)
0812 00:28:40.437172 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:40.437180 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:40.437511 (+ 331us) server_negotiation.cc:407] Connection header received
0812 00:28:40.437631 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:40.437635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:40.437707 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:40.437818 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:40.438592 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.439887 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.441437 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.441964 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.442074 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:40.446996 (+ 4922us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:35497: BlockingRecv error: recv got EOF from 127.29.190.130:35497 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 00:28:40 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:40 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:40.941170 11868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:40.931664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:34455)
0812 00:28:40.932327 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:40.932345 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:40.932473 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:40.932849 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:40.932852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:40.933280 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:40.933497 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:40.933508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.934927 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.934932 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:40.936045 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:40.936059 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.936916 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.936921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:40.937055 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:40.937756 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:40.937775 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:40.940919 (+ 3144us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":367,"threads_started":1}
W20260812 00:28:40.941437 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:40.932176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:34455 (local address 127.29.190.190:42953)
0812 00:28:40.932381 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:40.932386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:40.932406 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:28:40.932628 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:40.932633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:40.932708 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:40.932799 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:40.933669 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.934756 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.936217 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.936749 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.936869 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:40.941141 (+ 4272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:34455: BlockingRecv error: recv got EOF from 127.29.190.129:34455 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 00:28:40 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:40 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:40.968397 11870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:40.958223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:51597)
0812 00:28:40.959003 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:40.959051 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:40.959211 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:40.959771 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:40.959778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:40.960348 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:40.960597 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:40.960610 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.962049 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.962054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:40.963136 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:40.963149 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.964226 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.964231 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:40.964358 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:40.965002 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:40.965021 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:40.968134 (+ 3113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":503,"threads_started":1}
W20260812 00:28:40.968894 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:40.958356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:51597 (local address 127.29.190.190:42953)
0812 00:28:40.958721 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:40.958731 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:40.959325 (+ 594us) server_negotiation.cc:407] Connection header received
0812 00:28:40.959414 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:40.959421 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:40.959538 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:40.959650 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:40.960919 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.961881 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.963341 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:40.964032 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:40.964142 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:40.968434 (+ 4292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:51597: BlockingRecv error: recv got EOF from 127.29.190.131:51597 (error 108)
Metrics: {"server-negotiator.queue_time_us":195}
Aug 12 00:28:41 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:41 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:41.457696 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:41.448124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:60905)
0812 00:28:41.448718 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:41.448734 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:41.448908 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:41.449285 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:41.449290 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:41.449748 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:41.449922 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:41.449932 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.451006 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.451028 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:41.452167 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:41.452182 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.453014 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.453021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:41.453246 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:41.454178 (+ 932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:41.454197 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:41.457309 (+ 3112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":341,"threads_started":1}
W20260812 00:28:41.457785 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:41.448269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:60905 (local address 127.29.190.190:42953)
0812 00:28:41.448583 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:41.448590 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:41.448829 (+ 239us) server_negotiation.cc:407] Connection header received
0812 00:28:41.449049 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:41.449055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:41.449139 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:41.449250 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:41.450084 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.450866 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.452330 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.452822 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.452981 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:41.457544 (+ 4563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:60905: BlockingRecv error: recv got EOF from 127.29.190.130:60905 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 12 00:28:41 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:41 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:41.952095 11872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:41.942397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:59729)
0812 00:28:41.942977 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:41.942995 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:41.943124 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:41.943655 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:41.943659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:41.944094 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:41.944254 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:41.944264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.945529 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.945534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:41.946522 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:41.946536 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.947398 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.947405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:41.947661 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:41.948521 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:41.948542 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:41.951700 (+ 3158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":343,"threads_started":1}
W20260812 00:28:41.952240 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:41.942519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:59729 (local address 127.29.190.190:42953)
0812 00:28:41.942773 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:41.942778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:41.943145 (+ 367us) server_negotiation.cc:407] Connection header received
0812 00:28:41.943226 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:41.943230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:41.943300 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:41.943398 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:41.944451 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.945304 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.946734 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.947215 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.947459 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:41.951942 (+ 4483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:59729: BlockingRecv error: recv got EOF from 127.29.190.129:59729 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 12 00:28:41 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:41 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:41.978607 11876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:41.969592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:33397)
0812 00:28:41.970094 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:41.970116 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:41.970235 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:41.970588 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:41.970591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:41.971024 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:41.971240 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:41.971249 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.972644 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.972651 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:41.973664 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:41.973677 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.974448 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.974454 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:41.974641 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:41.975275 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:41.975295 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:41.978243 (+ 2948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":296,"threads_started":1}
W20260812 00:28:41.978732 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:41.969703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:33397 (local address 127.29.190.190:42953)
0812 00:28:41.969963 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:41.969969 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:41.970197 (+ 228us) server_negotiation.cc:407] Connection header received
0812 00:28:41.970338 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:41.970342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:41.970423 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:41.970512 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:41.971417 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.972511 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.973814 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:41.974271 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:41.974406 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:41.978462 (+ 4056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:33397: BlockingRecv error: recv got EOF from 127.29.190.131:33397 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 12 00:28:42 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:42 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:42.468366 11877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:42.459026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:55929)
0812 00:28:42.459628 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:42.459645 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:42.459770 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:42.460112 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:42.460115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:42.460538 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:42.460697 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:42.460706 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.462015 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.462027 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:42.463167 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:42.463180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.464030 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.464036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:42.464224 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:42.464945 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:42.464964 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:42.468014 (+ 3050us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":325,"threads_started":1}
W20260812 00:28:42.468495 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:42.459212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:55929 (local address 127.29.190.190:42953)
0812 00:28:42.459575 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:42.459583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:42.459705 (+ 122us) server_negotiation.cc:407] Connection header received
0812 00:28:42.459902 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:42.459906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:42.459976 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:42.460063 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:42.460893 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.461852 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.463321 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.463865 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.464013 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:42.468234 (+ 4221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:55929: BlockingRecv error: recv got EOF from 127.29.190.130:55929 (error 108)
Metrics: {"server-negotiator.queue_time_us":128}
Aug 12 00:28:42 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:42 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:42.962381 11878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:42.953383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:59385)
0812 00:28:42.954004 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:42.954021 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:42.954198 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:42.954575 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:42.954580 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:42.955014 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:42.955181 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:42.955190 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.956302 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.956307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:42.957260 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:42.957272 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.958080 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.958086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:42.958269 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:42.958960 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:42.958981 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:42.962104 (+ 3123us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":332,"threads_started":1}
W20260812 00:28:42.962589 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:42.953446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:59385 (local address 127.29.190.190:42953)
0812 00:28:42.953666 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:42.953677 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:42.954123 (+ 446us) server_negotiation.cc:407] Connection header received
0812 00:28:42.954332 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:42.954338 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:42.954414 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:42.954522 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:42.955341 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.956147 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.957418 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.957875 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.958022 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:42.962311 (+ 4289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:59385: BlockingRecv error: recv got EOF from 127.29.190.129:59385 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 00:28:42 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:42 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:42.989656 11879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:42.979961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:47581)
0812 00:28:42.980521 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:42.980565 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:42.980685 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:42.981012 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:42.981015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:42.981404 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:42.981592 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:42.981601 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.983469 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.983478 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:42.984546 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:42.984560 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.985419 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.985424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:42.985573 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:42.986272 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:42.986291 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:42.989418 (+ 3127us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":322,"threads_started":1}
W20260812 00:28:42.990140 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:42.979972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:47581 (local address 127.29.190.190:42953)
0812 00:28:42.980220 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:42.980229 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:42.980651 (+ 422us) server_negotiation.cc:407] Connection header received
0812 00:28:42.980790 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:42.980795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:42.980881 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:42.980974 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:42.981752 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.983257 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.984701 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:42.985164 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:42.985390 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:42.989728 (+ 4338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:47581: BlockingRecv error: recv got EOF from 127.29.190.131:47581 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 00:28:43 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:43 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:43.478807 11881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:43.469605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:37519)
0812 00:28:43.470179 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:43.470196 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:43.470311 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:43.470671 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:43.470675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:43.471096 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:43.471259 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:43.471269 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.472371 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.472384 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:43.473315 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:43.473328 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.474186 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.474191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:43.474314 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:43.475005 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:43.475023 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:43.478404 (+ 3381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":310,"threads_started":1}
W20260812 00:28:43.478878 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:43.469842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:37519 (local address 127.29.190.190:42953)
0812 00:28:43.470068 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:43.470073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:43.470274 (+ 201us) server_negotiation.cc:407] Connection header received
0812 00:28:43.470418 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:43.470422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:43.470487 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:43.470579 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:43.471412 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.472224 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.473507 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.474001 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.474116 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:43.478615 (+ 4499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:37519: BlockingRecv error: recv got EOF from 127.29.190.130:37519 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 00:28:43 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:43 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:43.973299 11882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:43.963400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:57729)
0812 00:28:43.964054 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:43.964081 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:43.964201 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:43.964658 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:43.964664 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:43.965048 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:43.965258 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:43.965267 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.966410 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.966414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:43.967357 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:43.967370 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.968242 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.968248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:43.968516 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:43.969210 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:43.969231 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:43.972946 (+ 3715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":365,"threads_started":1}
W20260812 00:28:43.973485 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:43.963557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:57729 (local address 127.29.190.190:42953)
0812 00:28:43.963756 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:43.963760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:43.964173 (+ 413us) server_negotiation.cc:407] Connection header received
0812 00:28:43.964375 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:43.964379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:43.964464 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:43.964574 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:43.965467 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.966257 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.967549 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.968069 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.968181 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:43.973199 (+ 5018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:57729: BlockingRecv error: recv got EOF from 127.29.190.129:57729 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 00:28:43 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:43 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:44.001175 11884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:43.990742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:56153)
0812 00:28:43.991336 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:43.991357 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:43.991553 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:43.991878 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:43.991881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:43.992408 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:43.992578 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:43.992589 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.993622 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.993626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:43.994700 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:43.994770 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.996042 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.996047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:43.996237 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:43.997034 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:43.997053 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:44.000879 (+ 3826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":322,"threads_started":1}
W20260812 00:28:44.001427 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:43.990781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:56153 (local address 127.29.190.190:42953)
0812 00:28:43.991099 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:43.991103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:43.991521 (+ 418us) server_negotiation.cc:407] Connection header received
0812 00:28:43.991671 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:43.991675 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:43.991740 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:43.991831 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:43.992723 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.993466 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.994964 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:43.995776 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:43.995920 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:44.001178 (+ 5258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:56153: BlockingRecv error: recv got EOF from 127.29.190.131:56153 (error 108)
Metrics: {"server-negotiator.queue_time_us":165}
Aug 12 00:28:44 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:44 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:44.493575 11886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:44.480035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:38759)
0812 00:28:44.480575 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:44.480598 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:44.480712 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:44.481203 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:44.481212 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:44.481615 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:44.481795 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:44.481805 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:44.482991 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:44.482996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:44.484072 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:44.484087 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:44.484957 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:44.484962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:44.485111 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:44.488993 (+ 3882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:44.489020 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:44.493156 (+ 4136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":300,"threads_started":1}
W20260812 00:28:44.493692 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:44.480136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:38759 (local address 127.29.190.190:42953)
0812 00:28:44.480357 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:44.480362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:44.480692 (+ 330us) server_negotiation.cc:407] Connection header received
0812 00:28:44.480879 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:44.480884 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:44.480979 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:44.481100 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:44.481968 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:44.482783 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:44.484236 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:44.484787 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:44.484896 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:44.493400 (+ 8504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:38759: BlockingRecv error: recv got EOF from 127.29.190.130:38759 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 00:28:44 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:44 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.129@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:44.984236 11888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:44.974728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.129:46655)
0812 00:28:44.975403 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:44.975423 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:44.975650 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:44.976214 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:44.976222 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:44.976815 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:44.977074 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:44.977090 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:44.978308 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:44.978313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:44.979403 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:44.979419 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:44.980209 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:44.980214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:44.980345 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:44.980951 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:44.980969 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:44.983963 (+ 2994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":391,"threads_started":1}
W20260812 00:28:44.984465 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:44.974838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:46655 (local address 127.29.190.190:42953)
0812 00:28:44.975122 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:44.975130 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:44.975564 (+ 434us) server_negotiation.cc:407] Connection header received
0812 00:28:44.975852 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:44.975857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:44.975967 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:44.976110 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:44.977263 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:44.978137 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:44.979593 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:44.980061 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:44.980163 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:44.984186 (+ 4023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.129:46655: BlockingRecv error: recv got EOF from 127.29.190.129:46655 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 12 00:28:45 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:45 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.131@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:45.012588 11889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:45.002371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.131:36685)
0812 00:28:45.003158 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:45.003206 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:45.003365 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:45.003823 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:45.003828 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:45.004358 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:45.004556 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:45.004566 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.005718 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.005725 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:45.006920 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:45.006934 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.008181 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.008186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:45.008348 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:45.009142 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:45.009162 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:45.012329 (+ 3167us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":405,"threads_started":1}
W20260812 00:28:45.012995 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:45.002456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:36685 (local address 127.29.190.190:42953)
0812 00:28:45.002675 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:45.002681 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:45.003300 (+ 619us) server_negotiation.cc:407] Connection header received
0812 00:28:45.003574 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:45.003579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:45.003665 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:45.003788 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:45.004717 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.005542 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.007133 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.007974 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.008103 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:45.012581 (+ 4478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.131:36685: BlockingRecv error: recv got EOF from 127.29.190.131:36685 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 00:28:45 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 00:28:45 dist-test-slave-c12x krb5kdc[10327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.190.130@KRBTEST.COM for oryx/127.29.190.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 00:28:45.505586 11890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:45.495219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42953 (local address 127.29.190.130:56707)
0812 00:28:45.495900 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:45.495921 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:45.496109 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:45.496572 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:45.496578 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:45.497104 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:45.497327 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:45.497339 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.498578 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.498586 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:45.499746 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:45.499761 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.500794 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.500803 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:45.501011 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:45.501852 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:45.501885 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:45.505137 (+ 3252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.190.190:42953: Server oryx/127.29.190.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":351,"threads_started":1}
W20260812 00:28:45.505709 11823 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:45.495262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:56707 (local address 127.29.190.190:42953)
0812 00:28:45.495609 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:45.495619 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:45.496040 (+ 421us) server_negotiation.cc:407] Connection header received
0812 00:28:45.496304 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:45.496309 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:45.496393 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:45.496529 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:45.497510 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.498396 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.499933 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.500582 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.500761 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:45.505386 (+ 4625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.190.130:56707: BlockingRecv error: recv got EOF from 127.29.190.130:56707 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
I20260812 00:28:45.825528 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 11205
I20260812 00:28:45.840699 11892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:45.827058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39720 (local address 127.29.190.129:32891)
0812 00:28:45.827745 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:45.827752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:45.827779 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:28:45.827853 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:45.827860 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:45.828083 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:45.828256 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:45.829853 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.830975 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.832374 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.833030 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.833158 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:45.836639 (+ 3481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:45.836652 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:45.836675 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:45.836739 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:45.840118 (+ 3379us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.29.190.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 00:28:45.840449 (+ 331us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39720: Request ticket server kudu/127.29.190.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":359,"threads_started":1}
W20260812 00:28:45.840835 11892 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39720: Request ticket server kudu/127.29.190.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 00:28:45.841022 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 11205: Not authorized: Client connection negotiation failed: client connection to 127.29.190.129:32891: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.29.190.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 00:28:45.841282 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 11205
I20260812 00:28:45.869083 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 11419
I20260812 00:28:45.883056 11894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:45.870372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.29.190.130:43481)
0812 00:28:45.871149 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:45.871158 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:45.871194 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:28:45.871265 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:45.871273 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:45.871594 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:45.871760 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:45.873242 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.874451 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.876035 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.876633 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.876750 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:45.879658 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:45.879668 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:45.879684 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:45.879726 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:45.882434 (+ 2708us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.29.190.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 00:28:45.882739 (+ 305us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53278: Request ticket server kudu/127.29.190.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":392,"threads_started":1}
W20260812 00:28:45.883186 11894 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53278: Request ticket server kudu/127.29.190.130@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 00:28:45.883301 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 11419: Not authorized: Client connection negotiation failed: client connection to 127.29.190.130:43481: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.29.190.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 00:28:45.883539 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 11419
I20260812 00:28:45.911099 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 11620
I20260812 00:28:45.925700 11898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:45.912335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45616 (local address 127.29.190.131:39435)
0812 00:28:45.912990 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:45.912998 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:45.913027 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:28:45.913094 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:45.913101 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:45.913350 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:45.913621 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:45.915131 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.916396 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.917737 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:45.918379 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:45.918548 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:45.921635 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:45.921645 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:45.921661 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:45.921709 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:45.924942 (+ 3233us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.29.190.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 00:28:45.925304 (+ 362us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45616: Request ticket server kudu/127.29.190.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":341,"threads_started":1}
W20260812 00:28:45.925725 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 11620: Not authorized: Client connection negotiation failed: client connection to 127.29.190.131:39435: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.29.190.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 00:28:45.925827 11898 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45616: Request ticket server kudu/127.29.190.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 00:28:45.925933 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 11620
I20260812 00:28:45.951771 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 11109
I20260812 00:28:45.953297 11195 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:46.073654 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 11109
2026-08-12T00:28:46Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22029 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T00:28:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:46Z Disabled control of system clock
I20260812 00:28:46.173035 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:39833
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:45755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:39833
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 00:28:46.538882 11905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:46.539220 11905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:46.539306 11905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:46.546904 11905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:46.547040 11905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:46.547080 11905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:46.547132 11905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:46.547179 11905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:46.556847 11905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:39833
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:39833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:46.558346 11905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:46.560231 11905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:46.574342 11911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:46.574254 11915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:46.574285 11913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:46.574893 11905 server_base.cc:1034] running on GCE node
I20260812 00:28:46.575978 11905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:46.577678 11905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:46.578974 11905 hybrid_clock.cc:648] HybridClock initialized: now 1786494526578924 us; error 50 us; skew 500 ppm
I20260812 00:28:46.579759 11905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:28:46.582994 11905 webserver.cc:460] Webserver started at http://127.29.190.190:35373/ using document root <none> and password file <none>
I20260812 00:28:46.583978 11905 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:46.584138 11905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:46.584550 11905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:46.588140 11905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "8b8168daec604d9c811708c74eac35a4"
format_stamp: "Formatted at 2026-08-12 00:28:46 on dist-test-slave-c12x"
server_key: "baeb131a962f7eeb5b4864a209742d97"
server_key_iv: "c3125401760bd3806f913ede1553de00"
server_key_version: "encryptionkey@0"
I20260812 00:28:46.589140 11905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "8b8168daec604d9c811708c74eac35a4"
format_stamp: "Formatted at 2026-08-12 00:28:46 on dist-test-slave-c12x"
server_key: "baeb131a962f7eeb5b4864a209742d97"
server_key_iv: "c3125401760bd3806f913ede1553de00"
server_key_version: "encryptionkey@0"
I20260812 00:28:46.595521 11905 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20260812 00:28:46.599309 11928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:46.600869 11905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 00:28:46.601089 11905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "8b8168daec604d9c811708c74eac35a4"
format_stamp: "Formatted at 2026-08-12 00:28:46 on dist-test-slave-c12x"
server_key: "baeb131a962f7eeb5b4864a209742d97"
server_key_iv: "c3125401760bd3806f913ede1553de00"
server_key_version: "encryptionkey@0"
I20260812 00:28:46.601343 11905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:46.620834 11905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:46.621786 11905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:46.622159 11905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:46.645747 12012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:39833 every 8 connection(s)
I20260812 00:28:46.645725 11905 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:39833
I20260812 00:28:46.647455 11905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:28:46.651510 12013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:46.654028 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 11905
I20260812 00:28:46.654233 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:28:46.655099 30458 external_mini_cluster.cc:1428] Setting key 90c13930bc0554c171624e88235e07bd
I20260812 00:28:46.664184 12013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4: Bootstrap starting.
I20260812 00:28:46.667572 12013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:46.669134 12013 log.cc:824] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:46.670876 12017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:46.657427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60032 (local address 127.29.190.190:39833)
0812 00:28:46.658583 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:46.658595 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:46.658642 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:28:46.660629 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:46.660656 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:46.661178 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:46.661634 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:46.662348 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:46.663852 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:46.665437 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:46.666238 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:46.666492 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:46.667940 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:46.667954 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:46.667982 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:46.668785 (+ 803us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:46.668918 (+ 133us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:46.668947 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:46.669072 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:46.669305 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 00:28:46.669667 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":443,"threads_started":1}
I20260812 00:28:46.672685 12013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4: No bootstrap required, opened a new log
I20260812 00:28:46.680881 12013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8168daec604d9c811708c74eac35a4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39833 } }
I20260812 00:28:46.681336 12013 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:46.681461 12013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b8168daec604d9c811708c74eac35a4, State: Initialized, Role: FOLLOWER
I20260812 00:28:46.682104 12013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8168daec604d9c811708c74eac35a4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39833 } }
I20260812 00:28:46.682363 12013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:28:46.682540 12013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:28:46.682724 12013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:46.685432 12013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8168daec604d9c811708c74eac35a4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39833 } }
I20260812 00:28:46.686065 12013 leader_election.cc:302] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b8168daec604d9c811708c74eac35a4; no voters:
I20260812 00:28:46.686741 12013 leader_election.cc:288] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:28:46.686955 12019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:46.687849 12019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [term 1 LEADER]: Becoming Leader. State: Replica: 8b8168daec604d9c811708c74eac35a4, State: Running, Role: LEADER
I20260812 00:28:46.688692 12019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8168daec604d9c811708c74eac35a4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39833 } }
I20260812 00:28:46.689471 12013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:46.691907 12023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b8168daec604d9c811708c74eac35a4. Latest consensus state: current_term: 1 leader_uuid: "8b8168daec604d9c811708c74eac35a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8168daec604d9c811708c74eac35a4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39833 } } }
I20260812 00:28:46.692456 12023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:46.692232 12022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b8168daec604d9c811708c74eac35a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8168daec604d9c811708c74eac35a4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 39833 } } }
I20260812 00:28:46.692615 12022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:46.694380 12032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:46.700336 12032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:46.711148 12032 catalog_manager.cc:1347] Generated new cluster ID: 71f4fee0220e4e0abe239671376f9b48
I20260812 00:28:46.711308 12032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:46.725062 12032 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:28:46.726544 12032 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:46.740480 12032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b8168daec604d9c811708c74eac35a4: Generated new TSK 0
I20260812 00:28:46.741567 12032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:28:46.748600 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39833
--builtin_ntp_servers=127.29.190.148:45755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 00:28:47.177709 12048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:47.178030 12048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:47.178177 12048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:47.185814 12048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:47.185933 12048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:47.186105 12048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:47.196272 12048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39833
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:47.197786 12048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:47.199735 12048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:47.214901 12060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:47.215004 12058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:47.214951 12057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:47.217283 12048 server_base.cc:1034] running on GCE node
I20260812 00:28:47.218111 12048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:47.219213 12048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:47.220463 12048 hybrid_clock.cc:648] HybridClock initialized: now 1786494527220392 us; error 65 us; skew 500 ppm
I20260812 00:28:47.220821 12048 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:28:47.223289 12048 webserver.cc:460] Webserver started at http://127.29.190.129:44207/ using document root <none> and password file <none>
I20260812 00:28:47.224128 12048 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:47.224264 12048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:47.224625 12048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:47.227821 12048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "3ce7105d3a614643b9b7bc744f3b0b23"
format_stamp: "Formatted at 2026-08-12 00:28:47 on dist-test-slave-c12x"
server_key: "00f46a53da32dd52f0e2faa9994b356b"
server_key_iv: "b580422dbd5ba7c18e6476ed86feea3e"
server_key_version: "encryptionkey@0"
I20260812 00:28:47.228711 12048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "3ce7105d3a614643b9b7bc744f3b0b23"
format_stamp: "Formatted at 2026-08-12 00:28:47 on dist-test-slave-c12x"
server_key: "00f46a53da32dd52f0e2faa9994b356b"
server_key_iv: "b580422dbd5ba7c18e6476ed86feea3e"
server_key_version: "encryptionkey@0"
I20260812 00:28:47.234634 12048 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:28:47.238881 12069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:47.240626 12048 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:47.240876 12048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "3ce7105d3a614643b9b7bc744f3b0b23"
format_stamp: "Formatted at 2026-08-12 00:28:47 on dist-test-slave-c12x"
server_key: "00f46a53da32dd52f0e2faa9994b356b"
server_key_iv: "b580422dbd5ba7c18e6476ed86feea3e"
server_key_version: "encryptionkey@0"
I20260812 00:28:47.241163 12048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:47.265003 12048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:47.266011 12048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:47.266366 12048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:47.267537 12048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:47.269162 12048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:47.269291 12048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:47.269443 12048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:47.269536 12048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:47.304662 12048 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:42075
I20260812 00:28:47.304795 12240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:42075 every 8 connection(s)
I20260812 00:28:47.306272 12048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:47.307801 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 12048
I20260812 00:28:47.308024 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:28:47.308679 30458 external_mini_cluster.cc:1428] Setting key 2ade4079f018f778dac8d083b3611f41
I20260812 00:28:47.312068 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39833
--builtin_ntp_servers=127.29.190.148:45755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:28:47.324044 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:47.309336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:53801 (local address 127.29.190.190:39833)
0812 00:28:47.312566 (+ 3230us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:47.312571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:47.312592 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:28:47.315137 (+ 2545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:47.315143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:47.315222 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:47.315326 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:47.316998 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:47.317770 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:47.320547 (+ 2777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:47.320984 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:47.321093 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:47.322918 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:47.322923 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:47.322926 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:47.322949 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:47.323001 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:47.323014 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:47.323087 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:47.323455 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 00:28:47.323587 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3051,"thread_start_us":2904,"threads_started":1}
I20260812 00:28:47.325156 12247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:47.310173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39833 (local address 127.29.190.129:53801)
0812 00:28:47.311838 (+ 1665us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:47.311903 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:47.314767 (+ 2864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:47.315675 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:47.315690 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:47.315835 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:47.316750 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:47.316780 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:47.317957 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:47.317965 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:47.320329 (+ 2364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:47.320349 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:47.321246 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:47.321257 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:47.321633 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:47.322475 (+ 842us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:28:47.322481 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:47.322542 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:28:47.322666 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:47.323127 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:47.323142 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:47.323152 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:28:47.323340 (+ 188us) client_negotiation.cc:240] Negotiation successful
0812 00:28:47.323829 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":991,"thread_start_us":699,"threads_started":1}
I20260812 00:28:47.326928 12241 heartbeater.cc:347] Connected to a master server at 127.29.190.190:39833
I20260812 00:28:47.327283 12241 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:47.328205 12241 heartbeater.cc:511] Master 127.29.190.190:39833 requested a full tablet report, sending...
I20260812 00:28:47.330770 11955 ts_manager.cc:194] Registered new tserver with Master: 3ce7105d3a614643b9b7bc744f3b0b23 (127.29.190.129:42075)
I20260812 00:28:47.333102 11955 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.129:53801
W20260812 00:28:47.676242 12248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:47.676597 12248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:47.676698 12248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:47.684940 12248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:47.685061 12248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:47.685168 12248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:47.694957 12248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39833
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:47.696455 12248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:47.698377 12248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:47.712363 12256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:47.712324 12259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:47.712456 12257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:47.713065 12248 server_base.cc:1034] running on GCE node
I20260812 00:28:47.714025 12248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:47.715111 12248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:47.716328 12248 hybrid_clock.cc:648] HybridClock initialized: now 1786494527716277 us; error 48 us; skew 500 ppm
I20260812 00:28:47.716692 12248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:28:47.719043 12248 webserver.cc:460] Webserver started at http://127.29.190.130:45057/ using document root <none> and password file <none>
I20260812 00:28:47.719858 12248 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:47.719960 12248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:47.720333 12248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:47.723255 12248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "91cf9a1ba59045eda99961a21800e161"
format_stamp: "Formatted at 2026-08-12 00:28:47 on dist-test-slave-c12x"
server_key: "92763e8fc6a3a25d85641e7f7db6bd4c"
server_key_iv: "5bdc58380d364c91ab5d62d6242c1ddc"
server_key_version: "encryptionkey@0"
I20260812 00:28:47.724159 12248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "91cf9a1ba59045eda99961a21800e161"
format_stamp: "Formatted at 2026-08-12 00:28:47 on dist-test-slave-c12x"
server_key: "92763e8fc6a3a25d85641e7f7db6bd4c"
server_key_iv: "5bdc58380d364c91ab5d62d6242c1ddc"
server_key_version: "encryptionkey@0"
I20260812 00:28:47.729700 12248 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260812 00:28:47.733685 12269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:47.735199 12248 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:47.735411 12248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "91cf9a1ba59045eda99961a21800e161"
format_stamp: "Formatted at 2026-08-12 00:28:47 on dist-test-slave-c12x"
server_key: "92763e8fc6a3a25d85641e7f7db6bd4c"
server_key_iv: "5bdc58380d364c91ab5d62d6242c1ddc"
server_key_version: "encryptionkey@0"
I20260812 00:28:47.735728 12248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:47.753214 12248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:47.754174 12248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:47.754522 12248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:47.755615 12248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:47.757174 12248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:47.757311 12248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:47.757472 12248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:47.757570 12248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:47.794147 12248 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:40557
I20260812 00:28:47.794205 12438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:40557 every 8 connection(s)
I20260812 00:28:47.795567 12248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:47.796526 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 12248
I20260812 00:28:47.796710 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:28:47.797363 30458 external_mini_cluster.cc:1428] Setting key b85c14a5ec898877af4e3455579c9766
I20260812 00:28:47.801179 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39833
--builtin_ntp_servers=127.29.190.148:45755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 00:28:47.813465 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:47.798872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:52461 (local address 127.29.190.190:39833)
0812 00:28:47.799060 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:47.799065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:47.801170 (+ 2105us) server_negotiation.cc:407] Connection header received
0812 00:28:47.804360 (+ 3190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:47.804365 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:47.804477 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:47.804572 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:47.806249 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:47.807131 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:47.810064 (+ 2933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:47.810522 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:47.810632 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:47.812531 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:47.812538 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:47.812542 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:47.812564 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:47.812600 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:47.812614 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:47.812741 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:47.813005 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 00:28:47.813137 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:28:47.814787 12443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:47.799682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39833 (local address 127.29.190.130:52461)
0812 00:28:47.800934 (+ 1252us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:47.801000 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:47.803997 (+ 2997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:47.804881 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:47.804907 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:47.805044 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:47.805999 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:47.806030 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:47.807315 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:47.807325 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:47.809858 (+ 2533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:47.809879 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:47.810785 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:47.810794 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:47.811189 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:47.812071 (+ 882us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:28:47.812078 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:47.812145 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:28:47.812272 (+ 127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:47.812740 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:47.812756 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:47.812767 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:28:47.812980 (+ 213us) client_negotiation.cc:240] Negotiation successful
0812 00:28:47.813427 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":381,"threads_started":1}
I20260812 00:28:47.816480 12441 heartbeater.cc:347] Connected to a master server at 127.29.190.190:39833
I20260812 00:28:47.816828 12441 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:47.817770 12441 heartbeater.cc:511] Master 127.29.190.190:39833 requested a full tablet report, sending...
I20260812 00:28:47.819643 11955 ts_manager.cc:194] Registered new tserver with Master: 91cf9a1ba59045eda99961a21800e161 (127.29.190.130:40557)
I20260812 00:28:47.821115 11955 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.130:52461
W20260812 00:28:48.163096 12444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:48.163425 12444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:48.163594 12444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:48.171034 12444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:48.171146 12444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:48.171254 12444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:48.180703 12444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:39833
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:48.182065 12444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:48.183990 12444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:48.198066 12453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:48.198143 12450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:48.198294 12451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:48.199002 12444 server_base.cc:1034] running on GCE node
I20260812 00:28:48.199766 12444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:48.200829 12444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:48.202101 12444 hybrid_clock.cc:648] HybridClock initialized: now 1786494528202040 us; error 60 us; skew 500 ppm
I20260812 00:28:48.202507 12444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:28:48.205106 12444 webserver.cc:460] Webserver started at http://127.29.190.131:46761/ using document root <none> and password file <none>
I20260812 00:28:48.205899 12444 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:48.206032 12444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:48.206374 12444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:48.209481 12444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "819cb5dac774484a8ca4e8f945a6e039"
format_stamp: "Formatted at 2026-08-12 00:28:48 on dist-test-slave-c12x"
server_key: "1365384d8a973c0fb0c3ad7a1b152d73"
server_key_iv: "807725181e8ef10edf741ae8f6acc2d4"
server_key_version: "encryptionkey@0"
I20260812 00:28:48.210364 12444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "819cb5dac774484a8ca4e8f945a6e039"
format_stamp: "Formatted at 2026-08-12 00:28:48 on dist-test-slave-c12x"
server_key: "1365384d8a973c0fb0c3ad7a1b152d73"
server_key_iv: "807725181e8ef10edf741ae8f6acc2d4"
server_key_version: "encryptionkey@0"
I20260812 00:28:48.216018 12444 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 00:28:48.219825 12461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:48.221254 12444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:28:48.221467 12444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "819cb5dac774484a8ca4e8f945a6e039"
format_stamp: "Formatted at 2026-08-12 00:28:48 on dist-test-slave-c12x"
server_key: "1365384d8a973c0fb0c3ad7a1b152d73"
server_key_iv: "807725181e8ef10edf741ae8f6acc2d4"
server_key_version: "encryptionkey@0"
I20260812 00:28:48.221719 12444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:48.237753 12444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:48.238811 12444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:48.239179 12444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:48.240411 12444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:48.242166 12444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:48.242297 12444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:48.242450 12444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:48.242544 12444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:48.279119 12444 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:39241
I20260812 00:28:48.279181 12632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:39241 every 8 connection(s)
I20260812 00:28:48.280606 12444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:48.286126 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 12444
I20260812 00:28:48.286309 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:28:48.286899 30458 external_mini_cluster.cc:1428] Setting key 394f1267a0bd16259ae98750313f0759
I20260812 00:28:48.295266 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:48.283657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:39877 (local address 127.29.190.190:39833)
0812 00:28:48.283891 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:48.283898 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:48.285183 (+ 1285us) server_negotiation.cc:407] Connection header received
0812 00:28:48.287675 (+ 2492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:48.287682 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:48.287803 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:48.287893 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:48.289510 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.290683 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.292534 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.292977 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.293079 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:48.294519 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:48.294524 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:48.294528 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:48.294546 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:48.294578 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:48.294590 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:48.294662 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:48.294903 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 00:28:48.294987 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 00:28:48.296533 12635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:48.284040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:39833 (local address 127.29.190.131:39877)
0812 00:28:48.285022 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:48.285065 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:48.287299 (+ 2234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:48.288199 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:48.288208 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:48.288320 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:48.289256 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:48.289288 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.290867 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.290872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:48.292345 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:48.292360 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.293187 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.293192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:48.293414 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:48.294158 (+ 744us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:28:48.294161 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:48.294204 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:28:48.294288 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:48.294689 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:48.294698 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:48.294705 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:28:48.294866 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 00:28:48.295190 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":344,"threads_started":1}
I20260812 00:28:48.298184 12633 heartbeater.cc:347] Connected to a master server at 127.29.190.190:39833
I20260812 00:28:48.298532 12633 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:48.299350 12633 heartbeater.cc:511] Master 127.29.190.190:39833 requested a full tablet report, sending...
I20260812 00:28:48.301033 11955 ts_manager.cc:194] Registered new tserver with Master: 819cb5dac774484a8ca4e8f945a6e039 (127.29.190.131:39241)
I20260812 00:28:48.301960 11955 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.131:39877
I20260812 00:28:48.303408 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:28:48.312044 12246 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:48.309984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60038 (local address 127.29.190.190:39833)
0812 00:28:48.310213 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:48.310223 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:48.310875 (+ 652us) server_negotiation.cc:407] Connection header received
0812 00:28:48.311072 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:48.311077 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:48.311157 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:48.311249 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:48.311807 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60038: BlockingRecv error: recv got EOF from 127.0.0.1:60038 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:28:48.312692 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 12048
I20260812 00:28:48.321554 12647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:48.313822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33484 (local address 127.29.190.129:42075)
0812 00:28:48.314429 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:48.314436 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:48.314464 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:28:48.314522 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:48.314528 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:48.314742 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:48.314877 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:48.315369 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.316627 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.317962 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.318576 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.318682 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:48.320050 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:48.320058 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:48.320072 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:48.320661 (+ 589us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:48.320710 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:48.320731 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:48.320826 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:48.321011 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 00:28:48.321174 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":313,"threads_started":1}
I20260812 00:28:48.322979 12234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:48.405731 12241 heartbeater.cc:503] Master 127.29.190.190:39833 was elected leader, sending a full tablet report...
I20260812 00:28:48.407163 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 12048
W20260812 00:28:48.430058 11934 connection.cc:535] server connection from 127.29.190.129:53801 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 00:28:48.430315 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 12248
I20260812 00:28:48.439133 12650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:48.431416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53544 (local address 127.29.190.130:40557)
0812 00:28:48.432038 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:48.432046 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:48.432074 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:28:48.432143 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:48.432150 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:48.432369 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:48.432516 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:48.432910 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.433941 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.435208 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.436015 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.436131 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:48.437333 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:48.437343 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:48.437359 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:48.438075 (+ 716us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:48.438136 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:48.438159 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:48.438266 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:48.438460 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 00:28:48.438644 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":284,"threads_started":1}
I20260812 00:28:48.440662 12431 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:48.524103 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 12248
I20260812 00:28:48.547838 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 12444
I20260812 00:28:48.556931 12653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:48.548963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56902 (local address 127.29.190.131:39241)
0812 00:28:48.549782 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:48.549793 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:48.549831 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:28:48.549931 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:48.549940 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:48.550229 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:48.550397 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:48.550933 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.552103 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.553433 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:48.554026 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:48.554174 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:48.555336 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:48.555345 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:48.555360 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:48.556039 (+ 679us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:48.556089 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:48.556111 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:48.556253 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:48.556411 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 00:28:48.556553 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":422,"threads_started":1}
I20260812 00:28:48.558372 12627 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:48.641702 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 12444
I20260812 00:28:48.669452 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 11905
I20260812 00:28:48.670893 12005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:48.777765 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 11905
2026-08-12T00:28:48Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2701 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T00:28:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:48Z Disabled control of system clock
I20260812 00:28:48.878515 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36207
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:36353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:36207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:28:49.233964 12660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:49.234331 12660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:49.234450 12660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:49.241801 12660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:49.241923 12660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:49.241963 12660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:49.242014 12660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:49.242060 12660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:49.251554 12660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:36207
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:49.252882 12660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:49.254742 12660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:49.267575 12669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:49.267620 12674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:49.267623 12666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:49.268615 12660 server_base.cc:1034] running on GCE node
I20260812 00:28:49.269486 12660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:49.271133 12660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:49.272389 12660 hybrid_clock.cc:648] HybridClock initialized: now 1786494529272311 us; error 61 us; skew 500 ppm
I20260812 00:28:49.272783 12660 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:28:49.275247 12660 webserver.cc:460] Webserver started at http://127.29.190.190:40279/ using document root <none> and password file <none>
I20260812 00:28:49.276096 12660 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:49.276193 12660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:49.276485 12660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:49.280028 12660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "bfadc4e7d40d458d8532772c077e7d46"
format_stamp: "Formatted at 2026-08-12 00:28:49 on dist-test-slave-c12x"
server_key: "b1d5b6211fd40529beab58d0b1151a57"
server_key_iv: "a4b8bd2a607e1ba60cb5ddf2f9e86fec"
server_key_version: "encryptionkey@0"
I20260812 00:28:49.281013 12660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "bfadc4e7d40d458d8532772c077e7d46"
format_stamp: "Formatted at 2026-08-12 00:28:49 on dist-test-slave-c12x"
server_key: "b1d5b6211fd40529beab58d0b1151a57"
server_key_iv: "a4b8bd2a607e1ba60cb5ddf2f9e86fec"
server_key_version: "encryptionkey@0"
I20260812 00:28:49.287236 12660 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:28:49.291580 12688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:49.293277 12660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:28:49.293462 12660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "bfadc4e7d40d458d8532772c077e7d46"
format_stamp: "Formatted at 2026-08-12 00:28:49 on dist-test-slave-c12x"
server_key: "b1d5b6211fd40529beab58d0b1151a57"
server_key_iv: "a4b8bd2a607e1ba60cb5ddf2f9e86fec"
server_key_version: "encryptionkey@0"
I20260812 00:28:49.293695 12660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:49.300952 12660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:49.301851 12660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:49.302168 12660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:49.323490 12660 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:36207
I20260812 00:28:49.323588 12769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:36207 every 8 connection(s)
I20260812 00:28:49.325121 12660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:28:49.328168 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 12660
I20260812 00:28:49.328408 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:28:49.329265 30458 external_mini_cluster.cc:1428] Setting key 9bff9c0b35fe2f03948172fa9b3f307d
I20260812 00:28:49.329543 12770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:49.339023 12775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:49.331425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53794 (local address 127.29.190.190:36207)
0812 00:28:49.332651 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:49.332663 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:49.332713 (+ 50us) server_negotiation.cc:407] Connection header received
0812 00:28:49.334744 (+ 2031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:49.334772 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:49.335270 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:49.335812 (+ 542us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:49.337122 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:49.337129 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:49.337142 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:49.337162 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:49.337235 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:49.337252 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:49.337549 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:49.337721 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 00:28:49.338007 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":444,"threads_started":1}
I20260812 00:28:49.344211 12770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46: Bootstrap starting.
I20260812 00:28:49.347604 12770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:49.348682 12770 log.cc:824] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:49.351687 12770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46: No bootstrap required, opened a new log
I20260812 00:28:49.359522 12770 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfadc4e7d40d458d8532772c077e7d46" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36207 } }
I20260812 00:28:49.359920 12770 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:49.359997 12770 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfadc4e7d40d458d8532772c077e7d46, State: Initialized, Role: FOLLOWER
I20260812 00:28:49.360590 12770 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfadc4e7d40d458d8532772c077e7d46" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36207 } }
I20260812 00:28:49.360800 12770 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:28:49.360915 12770 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:28:49.361038 12770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:49.363831 12770 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfadc4e7d40d458d8532772c077e7d46" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36207 } }
I20260812 00:28:49.364377 12770 leader_election.cc:302] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfadc4e7d40d458d8532772c077e7d46; no voters:
I20260812 00:28:49.365007 12770 leader_election.cc:288] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:28:49.365207 12779 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:49.366077 12779 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [term 1 LEADER]: Becoming Leader. State: Replica: bfadc4e7d40d458d8532772c077e7d46, State: Running, Role: LEADER
I20260812 00:28:49.366742 12779 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfadc4e7d40d458d8532772c077e7d46" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36207 } }
I20260812 00:28:49.367822 12770 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:49.370067 12780 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bfadc4e7d40d458d8532772c077e7d46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfadc4e7d40d458d8532772c077e7d46" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36207 } } }
I20260812 00:28:49.370471 12780 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:49.370204 12782 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfadc4e7d40d458d8532772c077e7d46. Latest consensus state: current_term: 1 leader_uuid: "bfadc4e7d40d458d8532772c077e7d46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfadc4e7d40d458d8532772c077e7d46" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36207 } } }
I20260812 00:28:49.370715 12782 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:49.376657 12786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:49.382831 12786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:49.393029 12786 catalog_manager.cc:1347] Generated new cluster ID: 0b18752affbf41ba8346fa991b9c1b5d
I20260812 00:28:49.393165 12786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:49.445250 12786 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:28:49.445789 12786 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:49.458957 12786 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfadc4e7d40d458d8532772c077e7d46: Generated new TSK 0
I20260812 00:28:49.460049 12786 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:28:49.470770 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36207
--builtin_ntp_servers=127.29.190.148:36353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 00:28:49.847287 12807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:49.847680 12807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:49.847847 12807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:49.857887 12807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:49.858011 12807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:49.858211 12807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:49.869316 12807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:49.870824 12807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:49.872943 12807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:49.887715 12813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:49.887691 12816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:49.887646 12822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:49.888942 12807 server_base.cc:1034] running on GCE node
I20260812 00:28:49.889678 12807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:49.890730 12807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:49.892000 12807 hybrid_clock.cc:648] HybridClock initialized: now 1786494529891952 us; error 45 us; skew 500 ppm
I20260812 00:28:49.892385 12807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:28:49.898574 12807 webserver.cc:460] Webserver started at http://127.29.190.129:38753/ using document root <none> and password file <none>
I20260812 00:28:49.899478 12807 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:49.899641 12807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:49.900008 12807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:49.903018 12807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "caba8bf24fc74023b529a0778f5005b1"
format_stamp: "Formatted at 2026-08-12 00:28:49 on dist-test-slave-c12x"
server_key: "b723634fa713c3fcf9a22637adaab919"
server_key_iv: "0cf9ba51622869452ab843b949ea06da"
server_key_version: "encryptionkey@0"
I20260812 00:28:49.903916 12807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "caba8bf24fc74023b529a0778f5005b1"
format_stamp: "Formatted at 2026-08-12 00:28:49 on dist-test-slave-c12x"
server_key: "b723634fa713c3fcf9a22637adaab919"
server_key_iv: "0cf9ba51622869452ab843b949ea06da"
server_key_version: "encryptionkey@0"
I20260812 00:28:49.909513 12807 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260812 00:28:49.913192 12831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:49.914620 12807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260812 00:28:49.914825 12807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "caba8bf24fc74023b529a0778f5005b1"
format_stamp: "Formatted at 2026-08-12 00:28:49 on dist-test-slave-c12x"
server_key: "b723634fa713c3fcf9a22637adaab919"
server_key_iv: "0cf9ba51622869452ab843b949ea06da"
server_key_version: "encryptionkey@0"
I20260812 00:28:49.915094 12807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:49.921012 12807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:49.921819 12807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:49.922107 12807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:49.923022 12807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:49.924511 12807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:49.924640 12807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:49.924783 12807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:49.924885 12807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:49.964031 12807 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:44687
I20260812 00:28:49.964085 13004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:44687 every 8 connection(s)
I20260812 00:28:49.965556 12807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:49.971652 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 12807
I20260812 00:28:49.971908 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:28:49.972733 30458 external_mini_cluster.cc:1428] Setting key 9d0949658d39e9d6d3880c1d87809333
I20260812 00:28:49.975873 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:49.968660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:40967 (local address 127.29.190.190:36207)
0812 00:28:49.969203 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:49.969211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:49.970610 (+ 1399us) server_negotiation.cc:407] Connection header received
0812 00:28:49.972646 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:49.972653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:49.972737 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:49.972906 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:49.974661 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:49.974668 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:49.974679 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:49.974698 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:49.974770 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:49.974792 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:49.974927 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:49.975393 (+ 466us) server_negotiation.cc:299] Negotiation successful
0812 00:28:49.975524 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":249,"threads_started":1}
I20260812 00:28:49.976334 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36207
--builtin_ntp_servers=127.29.190.148:36353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 00:28:49.976838 13012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:49.969392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36207 (local address 127.29.190.129:40967)
0812 00:28:49.970437 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:49.970486 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:49.972329 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:49.973197 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:49.973205 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:49.973298 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:49.974278 (+ 980us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:28:49.974282 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:49.974322 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:28:49.974417 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:49.975153 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:49.975163 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:49.975170 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 00:28:49.975414 (+ 244us) client_negotiation.cc:240] Negotiation successful
0812 00:28:49.975702 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":333,"threads_started":1}
I20260812 00:28:49.978571 13007 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36207
I20260812 00:28:49.978874 13007 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:49.979516 13007 heartbeater.cc:511] Master 127.29.190.190:36207 requested a full tablet report, sending...
I20260812 00:28:49.981640 12711 ts_manager.cc:194] Registered new tserver with Master: caba8bf24fc74023b529a0778f5005b1 (127.29.190.129:44687)
W20260812 00:28:50.343459 13013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:50.343859 13013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:50.344246 13013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:50.353202 13013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:50.353394 13013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:50.353588 13013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:50.363391 13013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:50.364962 13013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:50.366855 13013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:50.381412 13021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:50.381526 13026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:50.381552 13024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:50.382687 13013 server_base.cc:1034] running on GCE node
I20260812 00:28:50.383420 13013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:50.384617 13013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:50.385883 13013 hybrid_clock.cc:648] HybridClock initialized: now 1786494530385837 us; error 42 us; skew 500 ppm
I20260812 00:28:50.386262 13013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:28:50.388983 13013 webserver.cc:460] Webserver started at http://127.29.190.130:34451/ using document root <none> and password file <none>
I20260812 00:28:50.389793 13013 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:50.389947 13013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:50.390322 13013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:50.393483 13013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "c61489249c8040829e752dc55b2c6eea"
format_stamp: "Formatted at 2026-08-12 00:28:50 on dist-test-slave-c12x"
server_key: "3209abf80f66420cce8372b20b30d79d"
server_key_iv: "6d42a41424cb2fb966da882bb7881f3c"
server_key_version: "encryptionkey@0"
I20260812 00:28:50.394321 13013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "c61489249c8040829e752dc55b2c6eea"
format_stamp: "Formatted at 2026-08-12 00:28:50 on dist-test-slave-c12x"
server_key: "3209abf80f66420cce8372b20b30d79d"
server_key_iv: "6d42a41424cb2fb966da882bb7881f3c"
server_key_version: "encryptionkey@0"
I20260812 00:28:50.399919 13013 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260812 00:28:50.403630 13036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:50.405025 13013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:28:50.405164 13013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "c61489249c8040829e752dc55b2c6eea"
format_stamp: "Formatted at 2026-08-12 00:28:50 on dist-test-slave-c12x"
server_key: "3209abf80f66420cce8372b20b30d79d"
server_key_iv: "6d42a41424cb2fb966da882bb7881f3c"
server_key_version: "encryptionkey@0"
I20260812 00:28:50.405349 13013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:50.411211 13013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:50.412034 13013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:50.412266 13013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:50.413309 13013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:50.414677 13013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:50.414770 13013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:50.414844 13013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:50.414901 13013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:50.451480 13013 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:44033
I20260812 00:28:50.451623 13214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:44033 every 8 connection(s)
I20260812 00:28:50.452940 13013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:50.459187 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 13013
I20260812 00:28:50.459419 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:28:50.460042 30458 external_mini_cluster.cc:1428] Setting key 182381d2254c6826e4a95898211afdb7
I20260812 00:28:50.462226 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:50.455804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:56253 (local address 127.29.190.190:36207)
0812 00:28:50.456026 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:50.456032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:50.457472 (+ 1440us) server_negotiation.cc:407] Connection header received
0812 00:28:50.459542 (+ 2070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:50.459550 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:50.459636 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:50.459732 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:50.461422 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:50.461426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:50.461429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:50.461446 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:50.461479 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:50.461490 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:50.461648 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:50.461841 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 00:28:50.461914 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:28:50.463462 13217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:50.456331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36207 (local address 127.29.190.130:56253)
0812 00:28:50.457306 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:50.457343 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:50.459128 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:50.460022 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:50.460036 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:50.460168 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:50.461029 (+ 861us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:28:50.461033 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:50.461087 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:28:50.461203 (+ 116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:50.461599 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:50.461613 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:50.461624 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:28:50.461941 (+ 317us) client_negotiation.cc:240] Negotiation successful
0812 00:28:50.462207 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":303,"threads_started":1}
I20260812 00:28:50.463711 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36207
--builtin_ntp_servers=127.29.190.148:36353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 00:28:50.465117 13215 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36207
I20260812 00:28:50.465480 13215 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:50.466239 13215 heartbeater.cc:511] Master 127.29.190.190:36207 requested a full tablet report, sending...
I20260812 00:28:50.468019 12711 ts_manager.cc:194] Registered new tserver with Master: c61489249c8040829e752dc55b2c6eea (127.29.190.130:44033)
W20260812 00:28:50.820986 13218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:50.821332 13218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:50.821527 13218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:50.828882 13218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:50.829043 13218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:50.829236 13218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:50.838613 13218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36207
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:50.840090 13218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:50.841997 13218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:50.857116 13224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:50.857208 13225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:50.857371 13229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:50.865000 13218 server_base.cc:1034] running on GCE node
I20260812 00:28:50.865732 13218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:50.866773 13218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:50.868038 13218 hybrid_clock.cc:648] HybridClock initialized: now 1786494530867949 us; error 67 us; skew 500 ppm
I20260812 00:28:50.868412 13218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:28:50.870893 13218 webserver.cc:460] Webserver started at http://127.29.190.131:40289/ using document root <none> and password file <none>
I20260812 00:28:50.871833 13218 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:50.871937 13218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:50.872223 13218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:50.875309 13218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "5cb9d7bf204649dabb3351d024cb9cfa"
format_stamp: "Formatted at 2026-08-12 00:28:50 on dist-test-slave-c12x"
server_key: "1eae1100a0a69164add77d6273a4af1b"
server_key_iv: "8327be2a76566aa263f2ff25529a7b22"
server_key_version: "encryptionkey@0"
I20260812 00:28:50.876191 13218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "5cb9d7bf204649dabb3351d024cb9cfa"
format_stamp: "Formatted at 2026-08-12 00:28:50 on dist-test-slave-c12x"
server_key: "1eae1100a0a69164add77d6273a4af1b"
server_key_iv: "8327be2a76566aa263f2ff25529a7b22"
server_key_version: "encryptionkey@0"
I20260812 00:28:50.881506 13218 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 00:28:50.885488 13242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:50.887038 13218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:50.887264 13218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "5cb9d7bf204649dabb3351d024cb9cfa"
format_stamp: "Formatted at 2026-08-12 00:28:50 on dist-test-slave-c12x"
server_key: "1eae1100a0a69164add77d6273a4af1b"
server_key_iv: "8327be2a76566aa263f2ff25529a7b22"
server_key_version: "encryptionkey@0"
I20260812 00:28:50.887581 13218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:50.893838 13218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:50.894699 13218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:50.894991 13218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:50.896001 13218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:50.897517 13218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:50.897644 13218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:50.897794 13218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:50.897887 13218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:50.934770 13218 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:39953
I20260812 00:28:50.934867 13416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:39953 every 8 connection(s)
I20260812 00:28:50.936210 13218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:50.944731 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 13218
I20260812 00:28:50.944969 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:28:50.945392 13011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:50.939227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:60945 (local address 127.29.190.190:36207)
0812 00:28:50.939601 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:50.939606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:50.941045 (+ 1439us) server_negotiation.cc:407] Connection header received
0812 00:28:50.942843 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:50.942851 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:50.942930 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:50.943059 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:50.944613 (+ 1554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:50.944618 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:50.944621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:50.944640 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:50.944676 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:50.944688 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:50.944806 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:50.945102 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 00:28:50.945174 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260812 00:28:50.945559 30458 external_mini_cluster.cc:1428] Setting key 34843b2a8a8cbb4e87fd5748598e8531
I20260812 00:28:50.946589 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:50.939887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36207 (local address 127.29.190.131:60945)
0812 00:28:50.940854 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:50.940907 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:50.942545 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:50.943303 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:50.943312 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:50.943410 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:50.944201 (+ 791us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:28:50.944204 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:50.944244 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:28:50.944388 (+ 144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:50.944816 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:50.944830 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:50.944839 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:28:50.945173 (+ 334us) client_negotiation.cc:240] Negotiation successful
0812 00:28:50.945447 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":302,"threads_started":1}
I20260812 00:28:50.948052 13417 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36207
I20260812 00:28:50.948330 13417 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:50.948896 13417 heartbeater.cc:511] Master 127.29.190.190:36207 requested a full tablet report, sending...
I20260812 00:28:50.950274 12711 ts_manager.cc:194] Registered new tserver with Master: 5cb9d7bf204649dabb3351d024cb9cfa (127.29.190.131:39953)
I20260812 00:28:50.961723 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 00:28:50.968699 13011 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:28:50.966776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53810 (local address 127.29.190.190:36207)
0812 00:28:50.966975 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:50.966980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:50.967589 (+ 609us) server_negotiation.cc:407] Connection header received
0812 00:28:50.967786 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:50.967792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:50.967864 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:50.967978 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:50.968428 (+ 450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53810: BlockingRecv error: recv got EOF from 127.0.0.1:53810 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:28:50.969316 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 12807
I20260812 00:28:50.973183 13431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:50.970376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48308 (local address 127.29.190.129:44687)
0812 00:28:50.970916 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:50.970923 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:50.970949 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:28:50.971005 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:50.971011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:50.971211 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:50.971337 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:50.972340 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:50.972347 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:50.972358 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:50.972371 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:50.972421 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:50.972435 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:50.972577 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:50.972712 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 00:28:50.972823 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":242,"threads_started":1}
I20260812 00:28:50.974758 12998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:51.056876 13007 heartbeater.cc:503] Master 127.29.190.190:36207 was elected leader, sending a full tablet report...
I20260812 00:28:51.058692 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 12807
I20260812 00:28:51.086299 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 13013
I20260812 00:28:51.090443 13433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:51.087531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57580 (local address 127.29.190.130:44033)
0812 00:28:51.088106 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:51.088114 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:51.088141 (+ 27us) server_negotiation.cc:407] Connection header received
0812 00:28:51.088204 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:51.088210 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:51.088433 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:51.088615 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:51.089700 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:51.089706 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:51.089718 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:51.089736 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:51.089776 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:51.089789 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:51.089959 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:51.090045 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 00:28:51.090152 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":284,"threads_started":1}
I20260812 00:28:51.091965 13208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:51.175307 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 13013
I20260812 00:28:51.201501 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 13218
I20260812 00:28:51.206182 13435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:51.202706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54042 (local address 127.29.190.131:39953)
0812 00:28:51.203395 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:51.203403 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:51.203639 (+ 236us) server_negotiation.cc:407] Connection header received
0812 00:28:51.203728 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:51.203736 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:51.203957 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:51.204146 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:51.205385 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:51.205392 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:51.205403 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:28:51.205415 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:51.205454 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:28:51.205469 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:51.205680 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:51.205756 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 00:28:51.205868 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":374,"threads_started":1}
I20260812 00:28:51.207751 13410 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:51.291163 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 13218
I20260812 00:28:51.316299 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 12660
I20260812 00:28:51.317651 12764 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:51.422698 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 12660
2026-08-12T00:28:51Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2645 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:28:51 dist-test-slave-c12x krb5kdc[13444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:28:51 dist-test-slave-c12x krb5kdc[13444](info): set up 2 sockets
Aug 12 00:28:51 dist-test-slave-c12x krb5kdc[13444](info): commencing operation
krb5kdc: starting...
W20260812 00:28:52.758051 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:28:52 dist-test-slave-c12x krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494532, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:28:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:28:53.049620 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:45421
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:45421
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:53.402719 13472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:53.403040 13472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:53.403208 13472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:53.410823 13472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:28:53.410946 13472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:53.411031 13472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:53.411141 13472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:28:53.411203 13472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:28:53.421392 13472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:45421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:45421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:53.422801 13472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:53.424240 13472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:53.436555 13481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:53.436640 13485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:53.436630 13479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:53.437718 13472 server_base.cc:1034] running on GCE node
I20260812 00:28:53.438539 13472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:53.440155 13472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:53.441421 13472 hybrid_clock.cc:648] HybridClock initialized: now 1786494533441371 us; error 40 us; skew 500 ppm
I20260812 00:28:53.441810 13472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:53 dist-test-slave-c12x krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494533, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:53.445257 13472 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:28:53.446825 13472 webserver.cc:460] Webserver started at http://127.29.190.190:34139/ using document root <none> and password file <none>
I20260812 00:28:53.447638 13472 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:53.447791 13472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:53.448117 13472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:53.451267 13472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "23050b4d17c6420085ada873a7450168"
format_stamp: "Formatted at 2026-08-12 00:28:53 on dist-test-slave-c12x"
server_key: "27b7453110d9c88bd0bc0b9efa613c0b"
server_key_iv: "9d8f0e46fceb56da9d3db8af718d5d33"
server_key_version: "encryptionkey@0"
I20260812 00:28:53.452153 13472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "23050b4d17c6420085ada873a7450168"
format_stamp: "Formatted at 2026-08-12 00:28:53 on dist-test-slave-c12x"
server_key: "27b7453110d9c88bd0bc0b9efa613c0b"
server_key_iv: "9d8f0e46fceb56da9d3db8af718d5d33"
server_key_version: "encryptionkey@0"
I20260812 00:28:53.457640 13472 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:28:53.461349 13496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:53.462849 13472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:53.463090 13472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "23050b4d17c6420085ada873a7450168"
format_stamp: "Formatted at 2026-08-12 00:28:53 on dist-test-slave-c12x"
server_key: "27b7453110d9c88bd0bc0b9efa613c0b"
server_key_iv: "9d8f0e46fceb56da9d3db8af718d5d33"
server_key_version: "encryptionkey@0"
I20260812 00:28:53.463361 13472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:53.510834 13472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:53.516145 13472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:53.516533 13472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:53.538506 13472 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:45421
I20260812 00:28:53.538571 13577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:45421 every 8 connection(s)
I20260812 00:28:53.540261 13472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:28:53.544448 13578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:53.550029 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 13472
I20260812 00:28:53.550292 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:28:53.551097 30458 external_mini_cluster.cc:1428] Setting key 0d9d6f1b3af3e2a1fa9621b4d04b1621
I20260812 00:28:53.557005 13578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168: Bootstrap starting.
I20260812 00:28:53.560948 13578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:53.562291 13578 log.cc:824] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:53.566196 13578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168: No bootstrap required, opened a new log
Aug 12 00:28:53 dist-test-slave-c12x krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494532, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:53.575121 13578 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23050b4d17c6420085ada873a7450168" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45421 } }
I20260812 00:28:53.575611 13578 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:53.575742 13578 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23050b4d17c6420085ada873a7450168, State: Initialized, Role: FOLLOWER
I20260812 00:28:53.576495 13578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23050b4d17c6420085ada873a7450168" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45421 } }
I20260812 00:28:53.576776 13578 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:28:53.576941 13578 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:28:53.577150 13578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:53.578047 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:53.553536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59496 (local address 127.29.190.190:45421)
0812 00:28:53.554568 (+ 1032us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:53.554581 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:53.554636 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:28:53.556621 (+ 1985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:53.556660 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:53.557072 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:53.557499 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:53.559536 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:53.560854 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:53.562811 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:53.564094 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:53.564233 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:53.569610 (+ 5377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:53.569618 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:53.569634 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:53.569674 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:53.573182 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:53.574016 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:53.574027 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:53.574034 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:53.574217 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:53.574654 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:53.574659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:53.574664 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:53.575244 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:53.575656 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:53.576101 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 00:28:53.576580 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797,"thread_start_us":511,"threads_started":1}
I20260812 00:28:53.580262 13578 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23050b4d17c6420085ada873a7450168" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45421 } }
I20260812 00:28:53.580886 13578 leader_election.cc:302] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23050b4d17c6420085ada873a7450168; no voters:
I20260812 00:28:53.581633 13578 leader_election.cc:288] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:28:53.581745 13583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:28:53.582566 13583 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [term 1 LEADER]: Becoming Leader. State: Replica: 23050b4d17c6420085ada873a7450168, State: Running, Role: LEADER
I20260812 00:28:53.583263 13583 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23050b4d17c6420085ada873a7450168" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45421 } }
I20260812 00:28:53.584708 13578 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:28:53.586439 13587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23050b4d17c6420085ada873a7450168. Latest consensus state: current_term: 1 leader_uuid: "23050b4d17c6420085ada873a7450168" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23050b4d17c6420085ada873a7450168" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45421 } } }
I20260812 00:28:53.586975 13586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23050b4d17c6420085ada873a7450168" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23050b4d17c6420085ada873a7450168" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45421 } } }
I20260812 00:28:53.587613 13586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:53.587646 13587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168 [sys.catalog]: This master's current role is: LEADER
I20260812 00:28:53.589293 13591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:28:53.594488 13591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:28:53.604055 13591 catalog_manager.cc:1347] Generated new cluster ID: 946e4792fc464442b793450558128243
I20260812 00:28:53.604317 13591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:28:53.647104 13591 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:28:53.648731 13591 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:28:53.662954 13591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168: Generated new TSK 0
I20260812 00:28:53.663976 13591 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:28:53.755252 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45421
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:54.138119 13621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:54.138427 13621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:54.138525 13621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:54.146106 13621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:54.146234 13621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:54.146421 13621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:28:54.156471 13621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45421
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:54.157812 13621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:54.159148 13621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:54.172778 13628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:54.172892 13630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:54.172969 13632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:54.174204 13621 server_base.cc:1034] running on GCE node
I20260812 00:28:54.174891 13621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:54.176040 13621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:54.177310 13621 hybrid_clock.cc:648] HybridClock initialized: now 1786494534177249 us; error 74 us; skew 500 ppm
I20260812 00:28:54.177711 13621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:54 dist-test-slave-c12x krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494534, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:54.181197 13621 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:28:54.182880 13621 webserver.cc:460] Webserver started at http://127.29.190.129:34697/ using document root <none> and password file <none>
I20260812 00:28:54.183748 13621 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:54.183864 13621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:54.184142 13621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:54.187629 13621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "a9c84814d6ee42d0a17e3e087bec9569"
format_stamp: "Formatted at 2026-08-12 00:28:54 on dist-test-slave-c12x"
server_key: "f633c65b7ca6cd4e1059d4076cb87765"
server_key_iv: "bc08bb6510644ca19f8f84459aae4a96"
server_key_version: "encryptionkey@0"
I20260812 00:28:54.188423 13621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "a9c84814d6ee42d0a17e3e087bec9569"
format_stamp: "Formatted at 2026-08-12 00:28:54 on dist-test-slave-c12x"
server_key: "f633c65b7ca6cd4e1059d4076cb87765"
server_key_iv: "bc08bb6510644ca19f8f84459aae4a96"
server_key_version: "encryptionkey@0"
I20260812 00:28:54.194002 13621 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:28:54.197616 13640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:54.198987 13621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:54.199172 13621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "a9c84814d6ee42d0a17e3e087bec9569"
format_stamp: "Formatted at 2026-08-12 00:28:54 on dist-test-slave-c12x"
server_key: "f633c65b7ca6cd4e1059d4076cb87765"
server_key_iv: "bc08bb6510644ca19f8f84459aae4a96"
server_key_version: "encryptionkey@0"
I20260812 00:28:54.199368 13621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:54.211140 13621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:54.215828 13621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:54.216115 13621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:54.217139 13621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:54.218591 13621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:54.218672 13621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:54.218765 13621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:54.218814 13621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:54.254577 13621 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:35709
I20260812 00:28:54.254667 13813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:35709 every 8 connection(s)
I20260812 00:28:54.255946 13621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:28:54.261310 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 13621
I20260812 00:28:54.261556 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:28:54.262364 30458 external_mini_cluster.cc:1428] Setting key dc19ec71568ce7643a73fe2d46925d4f
Aug 12 00:28:54 dist-test-slave-c12x krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494534, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:54.278520 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:54.258599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:58795 (local address 127.29.190.190:45421)
0812 00:28:54.259065 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:54.259069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:54.259991 (+ 922us) server_negotiation.cc:407] Connection header received
0812 00:28:54.262461 (+ 2470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:54.262469 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:54.262560 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:54.262660 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:54.264371 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:54.265096 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:54.267725 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:54.268206 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:54.268306 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:54.272609 (+ 4303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:54.272614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:54.272617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:54.272648 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:54.275275 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:54.276062 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:54.276072 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:54.276075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:54.276202 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:54.276760 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:54.276767 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:54.276775 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:54.277043 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:54.277202 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:54.277927 (+ 725us) server_negotiation.cc:299] Negotiation successful
0812 00:28:54.278156 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":234,"threads_started":1}
I20260812 00:28:54.279592 13818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:54.259109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:45421 (local address 127.29.190.129:58795)
0812 00:28:54.259838 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:54.259878 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:54.262123 (+ 2245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:54.262979 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:54.262991 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:54.263630 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:54.264201 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:54.264219 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:54.265264 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:54.265272 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:54.267571 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:54.267590 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:54.268440 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:54.268449 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:54.268774 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:54.269554 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:54.269589 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:54.272344 (+ 2755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:54.275475 (+ 3131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:54.275487 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:54.275503 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:54.275927 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:54.276319 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:54.276324 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:54.276328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:54.276637 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:54.277178 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:54.277186 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:54.277534 (+ 348us) client_negotiation.cc:769] Sending connection context
0812 00:28:54.277807 (+ 273us) client_negotiation.cc:240] Negotiation successful
0812 00:28:54.278342 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":311,"threads_started":1}
I20260812 00:28:54.281320 13815 heartbeater.cc:347] Connected to a master server at 127.29.190.190:45421
I20260812 00:28:54.281688 13815 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:54.282600 13815 heartbeater.cc:511] Master 127.29.190.190:45421 requested a full tablet report, sending...
I20260812 00:28:54.285132 13527 ts_manager.cc:194] Registered new tserver with Master: a9c84814d6ee42d0a17e3e087bec9569 (127.29.190.129:35709)
I20260812 00:28:54.286711 13527 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:58795
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:28:54.328948 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45421
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:54.675377 13822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:54.675818 13822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:54.676002 13822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:54.683621 13822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:54.683789 13822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:54.683970 13822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:28:54.694509 13822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45421
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:54.696034 13822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:54.697464 13822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:28:54.711709 13833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:54.711829 13838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:54.711809 13834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:54.713011 13822 server_base.cc:1034] running on GCE node
I20260812 00:28:54.713762 13822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:54.714869 13822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:54.716118 13822 hybrid_clock.cc:648] HybridClock initialized: now 1786494534716041 us; error 77 us; skew 500 ppm
I20260812 00:28:54.716480 13822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:54 dist-test-slave-c12x krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494534, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:54.720260 13822 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:28:54.722173 13822 webserver.cc:460] Webserver started at http://127.29.190.130:44637/ using document root <none> and password file <none>
I20260812 00:28:54.722987 13822 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:54.723153 13822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:54.723599 13822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:54.726794 13822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "ceb4c06c9357413f98bc96b07609db3a"
format_stamp: "Formatted at 2026-08-12 00:28:54 on dist-test-slave-c12x"
server_key: "7ec81a519860509e3d7d900196d4a0d5"
server_key_iv: "548ff6b743a8a30686aa2215bdd033db"
server_key_version: "encryptionkey@0"
I20260812 00:28:54.727844 13822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "ceb4c06c9357413f98bc96b07609db3a"
format_stamp: "Formatted at 2026-08-12 00:28:54 on dist-test-slave-c12x"
server_key: "7ec81a519860509e3d7d900196d4a0d5"
server_key_iv: "548ff6b743a8a30686aa2215bdd033db"
server_key_version: "encryptionkey@0"
I20260812 00:28:54.733542 13822 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:28:54.737571 13847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:54.739017 13822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:28:54.739217 13822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "ceb4c06c9357413f98bc96b07609db3a"
format_stamp: "Formatted at 2026-08-12 00:28:54 on dist-test-slave-c12x"
server_key: "7ec81a519860509e3d7d900196d4a0d5"
server_key_iv: "548ff6b743a8a30686aa2215bdd033db"
server_key_version: "encryptionkey@0"
I20260812 00:28:54.739537 13822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:54.761293 13822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:54.766748 13822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:54.767136 13822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:54.768411 13822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:54.770036 13822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:54.770155 13822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:54.770313 13822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:54.770390 13822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:54.810076 13822 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:42131
I20260812 00:28:54.810123 14020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:42131 every 8 connection(s)
I20260812 00:28:54.811600 13822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:28:54.819270 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 13822
I20260812 00:28:54.819550 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:28:54.820123 30458 external_mini_cluster.cc:1428] Setting key 54e2307bb24a7ab41757ba2bbcfe8aff
Aug 12 00:28:54 dist-test-slave-c12x krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494534, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:54.837393 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:54.814914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:33381 (local address 127.29.190.190:45421)
0812 00:28:54.815381 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:54.815386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:54.816434 (+ 1048us) server_negotiation.cc:407] Connection header received
0812 00:28:54.818363 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:54.818369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:54.818478 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:54.818607 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:54.820950 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:54.821867 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:54.824347 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:54.824905 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:54.825054 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:54.830098 (+ 5044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:54.830104 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:54.830108 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:54.830151 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:54.833764 (+ 3613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:54.834680 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:54.834685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:54.834688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:54.834845 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:54.835375 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:54.835381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:54.835383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:54.835771 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:54.835974 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:54.836759 (+ 785us) server_negotiation.cc:299] Negotiation successful
0812 00:28:54.837008 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":236,"threads_started":1}
I20260812 00:28:54.838478 14028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:54.815301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:45421 (local address 127.29.190.130:33381)
0812 00:28:54.816219 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:54.816261 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:54.818059 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:54.818959 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:54.818975 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:54.819841 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:54.820720 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:54.820752 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:54.822050 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:54.822056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:54.824137 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:54.824158 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:54.825215 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:54.825224 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:54.825604 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:54.826515 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:54.826558 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:54.829747 (+ 3189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:54.833965 (+ 4218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:54.833977 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:54.834003 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:54.834509 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:54.834984 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:54.834990 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:54.834994 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:54.835221 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:54.835953 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:54.835962 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:54.836366 (+ 404us) client_negotiation.cc:769] Sending connection context
0812 00:28:54.836657 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 00:28:54.837259 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":313,"threads_started":1}
I20260812 00:28:54.840145 14022 heartbeater.cc:347] Connected to a master server at 127.29.190.190:45421
I20260812 00:28:54.840536 14022 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:54.841353 14022 heartbeater.cc:511] Master 127.29.190.190:45421 requested a full tablet report, sending...
I20260812 00:28:54.843168 13527 ts_manager.cc:194] Registered new tserver with Master: ceb4c06c9357413f98bc96b07609db3a (127.29.190.130:42131)
I20260812 00:28:54.844684 13527 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:33381
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:28:54.892268 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45421
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:28:55.256541 14038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:28:55.256815 14038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:28:55.256978 14038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:28:55.264657 14038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:28:55.264783 14038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:28:55.264959 14038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:28:55.275341 14038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45421
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:28:55.276929 14038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:28:55.278319 14038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 00:28:55.290802 13815 heartbeater.cc:503] Master 127.29.190.190:45421 was elected leader, sending a full tablet report...
W20260812 00:28:55.293128 14044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:55.293322 14045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:28:55.293718 14051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:28:55.294178 14038 server_base.cc:1034] running on GCE node
I20260812 00:28:55.294875 14038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:28:55.296036 14038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:28:55.297266 14038 hybrid_clock.cc:648] HybridClock initialized: now 1786494535297179 us; error 70 us; skew 500 ppm
I20260812 00:28:55.297659 14038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:28:55 dist-test-slave-c12x krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494535, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:28:55.306124 14038 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:28:55.308055 14038 webserver.cc:460] Webserver started at http://127.29.190.131:44029/ using document root <none> and password file <none>
I20260812 00:28:55.308807 14038 fs_manager.cc:359] Metadata directory not provided
I20260812 00:28:55.308915 14038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:28:55.309202 14038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:28:55.312287 14038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "453e1f201ccb4c5c89f44b09acaed6c9"
format_stamp: "Formatted at 2026-08-12 00:28:55 on dist-test-slave-c12x"
server_key: "b2f7916a14d36a7cfcd555b52a98e36d"
server_key_iv: "6daf29033c0b292e0172290adca46895"
server_key_version: "encryptionkey@0"
I20260812 00:28:55.313119 14038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "453e1f201ccb4c5c89f44b09acaed6c9"
format_stamp: "Formatted at 2026-08-12 00:28:55 on dist-test-slave-c12x"
server_key: "b2f7916a14d36a7cfcd555b52a98e36d"
server_key_iv: "6daf29033c0b292e0172290adca46895"
server_key_version: "encryptionkey@0"
I20260812 00:28:55.319658 14038 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:28:55.323717 14066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:55.325461 14038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:28:55.325627 14038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "453e1f201ccb4c5c89f44b09acaed6c9"
format_stamp: "Formatted at 2026-08-12 00:28:55 on dist-test-slave-c12x"
server_key: "b2f7916a14d36a7cfcd555b52a98e36d"
server_key_iv: "6daf29033c0b292e0172290adca46895"
server_key_version: "encryptionkey@0"
I20260812 00:28:55.325819 14038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:28:55.340176 14038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:28:55.345028 14038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:28:55.345317 14038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:28:55.346315 14038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:28:55.347858 14038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:28:55.347944 14038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:55.348033 14038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:28:55.348083 14038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:28:55.387720 14038 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:42763
I20260812 00:28:55.387756 14256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:42763 every 8 connection(s)
I20260812 00:28:55.389189 14038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:28:55.395054 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 14038
I20260812 00:28:55.395309 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:28:55.395974 30458 external_mini_cluster.cc:1428] Setting key 98ddbb403ef94056d6ff7f9f00b2c947
Aug 12 00:28:55 dist-test-slave-c12x krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494535, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:28:55.413699 14260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.392449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:58893 (local address 127.29.190.190:45421)
0812 00:28:55.393079 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.393084 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.394117 (+ 1033us) server_negotiation.cc:407] Connection header received
0812 00:28:55.396966 (+ 2849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.396972 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.397059 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.397182 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:55.399296 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.400397 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.402071 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.402544 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.402735 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.406507 (+ 3772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:55.406512 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:55.406516 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:55.406556 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:55.409721 (+ 3165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:55.410699 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:55.410705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:55.410709 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:55.410887 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:55.411532 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:55.411538 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:55.411540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:55.411964 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:55.412145 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.413210 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.413401 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":323,"threads_started":1}
I20260812 00:28:55.414880 14261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.393098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:45421 (local address 127.29.190.131:58893)
0812 00:28:55.393904 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:55.393950 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:55.396656 (+ 2706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:55.397526 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:55.397535 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:55.398147 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:28:55.399061 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.399093 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.400604 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.400608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.401908 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.401922 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.402838 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.402844 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.403067 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.403883 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:28:55.403924 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:28:55.406244 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:28:55.409894 (+ 3650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:55.409903 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:55.409919 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:55.410511 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:55.411036 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:28:55.411041 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:28:55.411044 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:28:55.411358 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:28:55.412177 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:28:55.412188 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:28:55.412755 (+ 567us) client_negotiation.cc:769] Sending connection context
0812 00:28:55.413088 (+ 333us) client_negotiation.cc:240] Negotiation successful
0812 00:28:55.413632 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":326,"threads_started":1}
I20260812 00:28:55.416424 14257 heartbeater.cc:347] Connected to a master server at 127.29.190.190:45421
I20260812 00:28:55.416842 14257 heartbeater.cc:464] Registering TS with master...
I20260812 00:28:55.417692 14257 heartbeater.cc:511] Master 127.29.190.190:45421 requested a full tablet report, sending...
I20260812 00:28:55.419276 13527 ts_manager.cc:194] Registered new tserver with Master: 453e1f201ccb4c5c89f44b09acaed6c9 (127.29.190.131:42763)
I20260812 00:28:55.420199 13527 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:58893
I20260812 00:28:55.425338 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:28:55.443488 14260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.430185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59502 (local address 127.29.190.190:45421)
0812 00:28:55.430422 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.430431 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.430809 (+ 378us) server_negotiation.cc:407] Connection header received
0812 00:28:55.431040 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.431045 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.431137 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.431251 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:55.432779 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.433536 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.434809 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.435252 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.435400 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.437689 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:55.437701 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:55.437705 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:55.437748 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:55.440560 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:55.441291 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:55.441298 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:55.441301 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:55.441451 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:55.441841 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:55.441846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:55.441850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:55.442200 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:55.442519 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.442866 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.443106 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:28:55.448141 13527 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59502:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:28:55.455199 13527 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:28:55.480785 14279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.469172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:42131 (local address 127.0.0.1:35856)
0812 00:28:55.470502 (+ 1330us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:55.470556 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:55.470740 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:55.471536 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:55.471544 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:55.471579 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:55.472037 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.472055 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.474401 (+ 2346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.474409 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.477449 (+ 3040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.477466 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.479597 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.479605 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.479839 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.479901 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 00:28:55.480071 (+ 170us) client_negotiation.cc:240] Negotiation successful
0812 00:28:55.480302 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1106,"mutex_wait_us":48,"thread_start_us":925,"threads_started":1}
I20260812 00:28:55.481383 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.469364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35856 (local address 127.29.190.130:42131)
0812 00:28:55.470037 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.470044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.470688 (+ 644us) server_negotiation.cc:407] Connection header received
0812 00:28:55.471005 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.471015 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.471265 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.471522 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:55.472289 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.474192 (+ 1903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.477632 (+ 3440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.479322 (+ 1690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.479539 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.479746 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.480125 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.480337 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":361,"threads_started":1}
I20260812 00:28:55.481767 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.471344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41120 (local address 127.29.190.131:42763)
0812 00:28:55.472324 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.472334 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.472979 (+ 645us) server_negotiation.cc:407] Connection header received
0812 00:28:55.473290 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.473299 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.473545 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.473711 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:55.475105 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.476631 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.478798 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.480047 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.480228 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.480390 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.481256 (+ 866us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.481444 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":771,"thread_start_us":1815,"threads_started":1}
I20260812 00:28:55.482342 14282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.470957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:42763 (local address 127.0.0.1:41120)
0812 00:28:55.472849 (+ 1892us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:55.472872 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:55.473096 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:55.474031 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:55.474036 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:55.474062 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:55.474886 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.474903 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.476807 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.476813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.478629 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.478643 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.480548 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.480554 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.480745 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.480792 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:28:55.481996 (+ 1204us) client_negotiation.cc:240] Negotiation successful
0812 00:28:55.482105 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1752,"thread_start_us":1579,"threads_started":1}
I20260812 00:28:55.484874 14286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.473920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35709 (local address 127.0.0.1:51946)
0812 00:28:55.474593 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:55.474607 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:55.474795 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:55.475479 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:55.475487 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:55.475520 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:55.475999 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.476014 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.477962 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.477968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.480312 (+ 2344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.480327 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.484061 (+ 3734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.484065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.484180 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.484201 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 00:28:55.484312 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 00:28:55.484439 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":4,"thread_start_us":343,"threads_started":1}
I20260812 00:28:55.484901 14285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.473231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51946 (local address 127.29.190.129:35709)
0812 00:28:55.473933 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.473941 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.474723 (+ 782us) server_negotiation.cc:407] Connection header received
0812 00:28:55.474959 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.474967 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.475230 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.475472 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:55.476207 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.477803 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.480550 (+ 2747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.483665 (+ 3115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.483804 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.483912 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.484361 (+ 449us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.484589 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":374,"threads_started":1}
I20260812 00:28:55.486295 14139 tablet_service.cc:1467] Processing CreateTablet for tablet 59b0b332bc5445b99e8c3bc09f7ea4af (DEFAULT_TABLE table=test-table [id=89d70bbd3aa6428886bd4d8547236fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:55.485850 13929 tablet_service.cc:1467] Processing CreateTablet for tablet 59b0b332bc5445b99e8c3bc09f7ea4af (DEFAULT_TABLE table=test-table [id=89d70bbd3aa6428886bd4d8547236fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:55.488098 14139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59b0b332bc5445b99e8c3bc09f7ea4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:55.488216 13929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59b0b332bc5445b99e8c3bc09f7ea4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:55.488432 13718 tablet_service.cc:1467] Processing CreateTablet for tablet 59b0b332bc5445b99e8c3bc09f7ea4af (DEFAULT_TABLE table=test-table [id=89d70bbd3aa6428886bd4d8547236fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:28:55.489595 13718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59b0b332bc5445b99e8c3bc09f7ea4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:28:55.501722 14287 tablet_bootstrap.cc:492] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: Bootstrap starting.
I20260812 00:28:55.504796 14288 tablet_bootstrap.cc:492] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Bootstrap starting.
I20260812 00:28:55.506150 14287 tablet_bootstrap.cc:654] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:55.506830 14290 tablet_bootstrap.cc:492] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: Bootstrap starting.
I20260812 00:28:55.507833 14287 log.cc:824] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:55.509332 14288 tablet_bootstrap.cc:654] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:55.510716 14288 log.cc:824] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:55.510789 14290 tablet_bootstrap.cc:654] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: Neither blocks nor log segments found. Creating new log.
I20260812 00:28:55.512306 14287 tablet_bootstrap.cc:492] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: No bootstrap required, opened a new log
I20260812 00:28:55.512297 14290 log.cc:824] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: Log is configured to *not* fsync() on all Append() calls
I20260812 00:28:55.512647 14287 ts_tablet_manager.cc:1397] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20260812 00:28:55.514248 14288 tablet_bootstrap.cc:492] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: No bootstrap required, opened a new log
I20260812 00:28:55.514549 14288 ts_tablet_manager.cc:1397] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260812 00:28:55.515285 14290 tablet_bootstrap.cc:492] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: No bootstrap required, opened a new log
I20260812 00:28:55.515655 14290 ts_tablet_manager.cc:1397] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260812 00:28:55.524330 14290 raft_consensus.cc:348] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.524194 14287 raft_consensus.cc:348] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.524752 14287 raft_consensus.cc:374] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:55.524762 14290 raft_consensus.cc:374] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:55.524858 14287 raft_consensus.cc:729] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9c84814d6ee42d0a17e3e087bec9569, State: Initialized, Role: FOLLOWER
I20260812 00:28:55.524860 14290 raft_consensus.cc:729] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 453e1f201ccb4c5c89f44b09acaed6c9, State: Initialized, Role: FOLLOWER
I20260812 00:28:55.525563 14290 consensus_queue.cc:260] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.525604 14287 consensus_queue.cc:260] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.525612 14288 raft_consensus.cc:348] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.526078 14288 raft_consensus.cc:374] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:28:55.526232 14288 raft_consensus.cc:729] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb4c06c9357413f98bc96b07609db3a, State: Initialized, Role: FOLLOWER
I20260812 00:28:55.527052 14257 heartbeater.cc:503] Master 127.29.190.190:45421 was elected leader, sending a full tablet report...
I20260812 00:28:55.527045 14288 consensus_queue.cc:260] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.528831 14022 heartbeater.cc:503] Master 127.29.190.190:45421 was elected leader, sending a full tablet report...
I20260812 00:28:55.529527 14288 ts_tablet_manager.cc:1428] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260812 00:28:55.531265 14287 ts_tablet_manager.cc:1428] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: Time spent starting tablet: real 0.018s user 0.010s sys 0.008s
I20260812 00:28:55.531708 14290 ts_tablet_manager.cc:1428] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: Time spent starting tablet: real 0.016s user 0.012s sys 0.000s
I20260812 00:28:55.541262 14298 raft_consensus.cc:482] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:28:55.541642 14298 raft_consensus.cc:504] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.543583 14298 leader_election.cc:288] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 453e1f201ccb4c5c89f44b09acaed6c9 (127.29.190.131:42763), a9c84814d6ee42d0a17e3e087bec9569 (127.29.190.129:35709)
I20260812 00:28:55.552027 14285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.545174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:56211 (local address 127.29.190.129:35709)
0812 00:28:55.545570 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.545576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.545851 (+ 275us) server_negotiation.cc:407] Connection header received
0812 00:28:55.546086 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.546091 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.546161 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.546260 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:55.546800 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.547616 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.549700 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.550909 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.551047 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.551143 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.551623 (+ 480us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.551757 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242}
I20260812 00:28:55.552225 14301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.544888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35709 (local address 127.29.190.130:56211)
0812 00:28:55.545738 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:55.545753 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:55.545941 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:55.546276 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:55.546281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:55.546304 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:55.546645 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.546654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.547757 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.547763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.549462 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.549503 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.551267 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.551272 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.551391 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.551417 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:28:55.551597 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 00:28:55.551746 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":57,"thread_start_us":545,"threads_started":1}
I20260812 00:28:55.553073 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.543927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:34783 (local address 127.29.190.131:42763)
0812 00:28:55.544161 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.544167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.544864 (+ 697us) server_negotiation.cc:407] Connection header received
0812 00:28:55.545157 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.545164 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.545239 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.545299 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:28:55.546361 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.547576 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.550315 (+ 2739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.551597 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.551754 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.551824 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.552724 (+ 900us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.552877 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:28:55.553612 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.543950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:42763 (local address 127.29.190.130:34783)
0812 00:28:55.544757 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0812 00:28:55.544777 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:28:55.544980 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:28:55.545700 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:28:55.545705 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:28:55.545738 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:28:55.546193 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.546205 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.547761 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.547766 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.550121 (+ 2355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:28:55.550137 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.551981 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.551988 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:28:55.552529 (+ 541us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.552566 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:28:55.552660 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 00:28:55.552796 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"mutex_wait_us":34,"spinlock_wait_cycles":27392,"thread_start_us":446,"threads_started":1}
I20260812 00:28:55.553412 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59b0b332bc5445b99e8c3bc09f7ea4af" candidate_uuid: "ceb4c06c9357413f98bc96b07609db3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9c84814d6ee42d0a17e3e087bec9569" is_pre_election: true
I20260812 00:28:55.554049 13744 raft_consensus.cc:2454] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb4c06c9357413f98bc96b07609db3a in term 0.
I20260812 00:28:55.554582 14164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59b0b332bc5445b99e8c3bc09f7ea4af" candidate_uuid: "ceb4c06c9357413f98bc96b07609db3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" is_pre_election: true
I20260812 00:28:55.554806 13849 leader_election.cc:302] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9c84814d6ee42d0a17e3e087bec9569, ceb4c06c9357413f98bc96b07609db3a; no voters:
I20260812 00:28:55.555176 14164 raft_consensus.cc:2454] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ceb4c06c9357413f98bc96b07609db3a in term 0.
I20260812 00:28:55.555260 14298 raft_consensus.cc:2781] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:28:55.555408 14298 raft_consensus.cc:482] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:28:55.555560 14298 raft_consensus.cc:3037] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:55.557984 14298 raft_consensus.cc:504] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.558732 14298 leader_election.cc:288] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [CANDIDATE]: Term 1 election: Requested vote from peers 453e1f201ccb4c5c89f44b09acaed6c9 (127.29.190.131:42763), a9c84814d6ee42d0a17e3e087bec9569 (127.29.190.129:35709)
I20260812 00:28:55.559362 14164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59b0b332bc5445b99e8c3bc09f7ea4af" candidate_uuid: "ceb4c06c9357413f98bc96b07609db3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "453e1f201ccb4c5c89f44b09acaed6c9"
I20260812 00:28:55.559383 13744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59b0b332bc5445b99e8c3bc09f7ea4af" candidate_uuid: "ceb4c06c9357413f98bc96b07609db3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9c84814d6ee42d0a17e3e087bec9569"
I20260812 00:28:55.559638 13744 raft_consensus.cc:3037] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:55.559635 14164 raft_consensus.cc:3037] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:28:55.563010 14164 raft_consensus.cc:2454] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb4c06c9357413f98bc96b07609db3a in term 1.
I20260812 00:28:55.563010 13744 raft_consensus.cc:2454] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ceb4c06c9357413f98bc96b07609db3a in term 1.
I20260812 00:28:55.563475 13849 leader_election.cc:302] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9c84814d6ee42d0a17e3e087bec9569, ceb4c06c9357413f98bc96b07609db3a; no voters:
I20260812 00:28:55.563779 14298 raft_consensus.cc:2781] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 1 FOLLOWER]: Leader election won for term 1
W20260812 00:28:55.564306 14024 tablet.cc:2369] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:28:55.564378 14298 raft_consensus.cc:686] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 1 LEADER]: Becoming Leader. State: Replica: ceb4c06c9357413f98bc96b07609db3a, State: Running, Role: LEADER
I20260812 00:28:55.565011 14298 consensus_queue.cc:237] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } }
I20260812 00:28:55.570261 13522 catalog_manager.cc:5495] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a reported cstate change: term changed from 0 to 1, leader changed from <none> to ceb4c06c9357413f98bc96b07609db3a (127.29.190.130). New cstate: current_term: 1 leader_uuid: "ceb4c06c9357413f98bc96b07609db3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4c06c9357413f98bc96b07609db3a" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 } health_report { overall_health: UNKNOWN } } }
I20260812 00:28:55.608628 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.602889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35866 (local address 127.29.190.130:42131)
0812 00:28:55.603100 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.603105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.603124 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:28:55.603316 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.603320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.603402 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.603679 (+ 277us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:28:55.604099 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.604822 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.606288 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.606749 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.606855 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.607404 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:28:55.608074 (+ 670us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:28:55.608188 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.608326 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.608401 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:28:55.618706 14164 raft_consensus.cc:1261] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 1 FOLLOWER]: Refusing update from remote peer ceb4c06c9357413f98bc96b07609db3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:55.618698 13744 raft_consensus.cc:1261] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 1 FOLLOWER]: Refusing update from remote peer ceb4c06c9357413f98bc96b07609db3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:28:55.620042 14298 consensus_queue.cc:1035] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9c84814d6ee42d0a17e3e087bec9569" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:55.620543 14302 consensus_queue.cc:1035] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "453e1f201ccb4c5c89f44b09acaed6c9" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:28:55.651911 13523 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59502:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:55.652258 13523 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59502:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:28:55.656469 13523 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 23050b4d17c6420085ada873a7450168: Sending DeleteTablet for 3 replicas of tablet 59b0b332bc5445b99e8c3bc09f7ea4af
I20260812 00:28:55.657770 13929 tablet_service.cc:1514] Processing DeleteTablet for tablet 59b0b332bc5445b99e8c3bc09f7ea4af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:55 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:35856
I20260812 00:28:55.658200 13718 tablet_service.cc:1514] Processing DeleteTablet for tablet 59b0b332bc5445b99e8c3bc09f7ea4af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:55 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:51946
I20260812 00:28:55.658241 14139 tablet_service.cc:1514] Processing DeleteTablet for tablet 59b0b332bc5445b99e8c3bc09f7ea4af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:28:55 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:41120
I20260812 00:28:55.659111 14326 tablet_replica.cc:330] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: stopping tablet replica
I20260812 00:28:55.659264 14327 tablet_replica.cc:330] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: stopping tablet replica
I20260812 00:28:55.659687 14326 raft_consensus.cc:2229] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:28:55.659710 14327 raft_consensus.cc:2229] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:55.660265 14327 raft_consensus.cc:2258] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:55.660529 14326 raft_consensus.cc:2258] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:55.661675 14328 tablet_replica.cc:330] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: stopping tablet replica
I20260812 00:28:55.662150 14328 raft_consensus.cc:2229] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:28:55.662503 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 13621
I20260812 00:28:55.662751 14328 raft_consensus.cc:2258] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:28:55.663094 14326 ts_tablet_manager.cc:1905] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:55.663280 14327 ts_tablet_manager.cc:1905] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:55.669696 14328 ts_tablet_manager.cc:1905] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:28:55.671535 14326 ts_tablet_manager.cc:1918] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:55.671749 14326 log.cc:1196] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/59b0b332bc5445b99e8c3bc09f7ea4af
I20260812 00:28:55.672350 14326 ts_tablet_manager.cc:1939] T 59b0b332bc5445b99e8c3bc09f7ea4af P ceb4c06c9357413f98bc96b07609db3a: Deleting consensus metadata
I20260812 00:28:55.673579 14327 ts_tablet_manager.cc:1918] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:55.673877 14327 log.cc:1196] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/59b0b332bc5445b99e8c3bc09f7ea4af
I20260812 00:28:55.674530 13498 catalog_manager.cc:4841] TS ceb4c06c9357413f98bc96b07609db3a (127.29.190.130:42131): tablet 59b0b332bc5445b99e8c3bc09f7ea4af (table test-table [id=89d70bbd3aa6428886bd4d8547236fcd]) successfully deleted
I20260812 00:28:55.675385 14327 ts_tablet_manager.cc:1939] T 59b0b332bc5445b99e8c3bc09f7ea4af P 453e1f201ccb4c5c89f44b09acaed6c9: Deleting consensus metadata
I20260812 00:28:55.677573 13498 catalog_manager.cc:4841] TS 453e1f201ccb4c5c89f44b09acaed6c9 (127.29.190.131:42763): tablet 59b0b332bc5445b99e8c3bc09f7ea4af (table test-table [id=89d70bbd3aa6428886bd4d8547236fcd]) successfully deleted
I20260812 00:28:55.677832 14328 ts_tablet_manager.cc:1918] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:28:55.678042 14328 log.cc:1196] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/59b0b332bc5445b99e8c3bc09f7ea4af
I20260812 00:28:55.678679 14328 ts_tablet_manager.cc:1939] T 59b0b332bc5445b99e8c3bc09f7ea4af P a9c84814d6ee42d0a17e3e087bec9569: Deleting consensus metadata
I20260812 00:28:55.680804 13498 catalog_manager.cc:4841] TS a9c84814d6ee42d0a17e3e087bec9569 (127.29.190.129:35709): tablet 59b0b332bc5445b99e8c3bc09f7ea4af (table test-table [id=89d70bbd3aa6428886bd4d8547236fcd]) successfully deleted
Aug 12 00:28:55 dist-test-slave-c12x krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494532, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:28:55.691577 14285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.663686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51962 (local address 127.29.190.129:35709)
0812 00:28:55.663871 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.663879 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.674572 (+ 10693us) server_negotiation.cc:407] Connection header received
0812 00:28:55.675188 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.675194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.675301 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.675393 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:55.677499 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.678542 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.679977 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.680420 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.680570 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.685166 (+ 4596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:55.685181 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:55.685198 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:55.685237 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:55.688505 (+ 3268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:55.689285 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:55.689293 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:55.689295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:55.689435 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:55.689851 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:55.689858 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:55.689866 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:55.690262 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:55.690596 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.690903 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.691141 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:28:55.692389 13806 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:55.787112 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 13621
I20260812 00:28:55.820556 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 13822
Aug 12 00:28:55 dist-test-slave-c12x krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494532, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:28:55.840622 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.821382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35878 (local address 127.29.190.130:42131)
0812 00:28:55.821596 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.821602 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.821625 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:28:55.821831 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.821836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.821956 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.822092 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:55.823701 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.824976 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.826848 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.827647 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.827792 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:55.833535 (+ 5743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:55.833559 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:55.833576 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:55.833629 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:55.837000 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:55.837896 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:55.837904 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:55.837906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:55.838140 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:55.838693 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:55.838699 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:55.838704 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:55.839278 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:55.839666 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:55.839983 (+ 317us) server_negotiation.cc:299] Negotiation successful
0812 00:28:55.840249 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:28:55.841447 14016 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:55.960866 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 13822
I20260812 00:28:55.991993 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 14038
Aug 12 00:28:55 dist-test-slave-c12x krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494532, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:28:56.010385 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:28:55.992956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41126 (local address 127.29.190.131:42763)
0812 00:28:55.993191 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:28:55.993198 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:28:55.993224 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:28:55.993446 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:28:55.993467 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:28:55.993575 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:28:55.993706 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:28:55.995240 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.996233 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.997797 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:28:55.998253 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:28:55.998416 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:28:56.003416 (+ 5000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:28:56.003482 (+ 66us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:28:56.003509 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:28:56.003567 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:28:56.006893 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:56.007872 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:56.007882 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:56.007884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:56.008061 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:28:56.008515 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:28:56.008521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:28:56.008525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:28:56.008974 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:28:56.009347 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0812 00:28:56.009719 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 00:28:56.009998 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:28:56.011190 14243 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:56.104475 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 14038
I20260812 00:28:56.130558 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 13472
I20260812 00:28:56.132128 13573 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:28:56.245874 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 13472
2026-08-12T00:28:56Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4824 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:28:56 dist-test-slave-c12x krb5kdc[14343](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:28:56 dist-test-slave-c12x krb5kdc[14343](info): set up 2 sockets
Aug 12 00:28:56 dist-test-slave-c12x krb5kdc[14343](info): commencing operation
krb5kdc: starting...
W20260812 00:28:57.614984 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:28:57 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:28:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:28:57Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.29.190.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.29.190.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/rangeradmin_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/rangeradmin_127.29.190.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.29.190.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.29.190.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/rangerlookup_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/rangerlookup_127.29.190.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.190.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.29.190.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/HTTP_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/HTTP_127.29.190.148@KRBTEST.COM.keytab.
I20260812 00:28:58.032073 30458 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXieYLm/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/postgres -l logfile start
2026-08-12 00:29:00.685 UTC [14388] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:29:00.685 UTC [14388] LOG: listening on IPv4 address "127.29.190.148", port 46945
2026-08-12 00:29:00.689 UTC [14388] LOG: listening on Unix socket "/tmp/.s.PGSQL.46945"
2026-08-12 00:29:00.713 UTC [14392] LOG: database system was shut down at 2026-08-12 00:28:59 UTC
2026-08-12 00:29:00.717 UTC [14388] LOG: database system is ready to accept connections
I20260812 00:29:01.897967 30458 mini_postgres.cc:96] Postgres bound to 46945
2026-08-12 00:29:01.925 UTC [14408] FATAL: database "slave" does not exist
127.29.190.148:46945 - accepting connections
I20260812 00:29:01.926119 30458 mini_ranger.cc:161] Starting Ranger...
I20260812 00:29:01.961971 30458 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:29:02.513754 30458 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:29:02.513926 30458 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-admin
2026-08-12 00:29:02,862 [I] DB FLAVOR :POSTGRES
2026-08-12 00:29:02,863 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:29:02,863 [I] Checking connection..
2026-08-12 00:29:02,863 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:29:03,142 [I] Checking connection passed.
2026-08-12 00:29:03,142 [I] --------- Verifying version history table ---------
2026-08-12 00:29:03,142 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:29:03,418 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:29:03,418 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:29:03,686 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:29:03,686 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:29:03,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:29:03.933 UTC [14506] WARNING: there is no transaction in progress
2026-08-12 00:29:03,940 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:29:03,941 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:29:04,220 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:29:04,220 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:29:04,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:29:04,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:29:04,758 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-c12x.c.gcp-upstream.internal','N') ;"
2026-08-12 00:29:05,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:29:05,291 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:29:05,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:29:05,558 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:29:05,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:29:05,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:29:06,079 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:29:06,079 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:29:07.164 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.181 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.199 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.215 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.232 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.252 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.314 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.323 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.341 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.352 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.363 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.379 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.390 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.398 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.407 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:07.416 UTC [14685] WARNING: there is no transaction in progress
2026-08-12 00:29:08,153 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:29:08,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:29:08,414 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:29:08,415 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:29:08,690 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:29:08,691 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:29:08,975 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:29:08,975 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:29:09,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:29:09,514 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-c12x.c.gcp-upstream.internal';"
2026-08-12 00:29:09,791 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:29:09,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:29:10,073 [I] DB_PATCHES have already been applied
I20260812 00:29:10.080176 30458 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXieYLm/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:29:10.080271 30458 mini_ranger.cc:193] Using host: 127.29.190.148
I20260812 00:29:10.101614 30458 mini_ranger.cc:227] Ranger admin URL: http://127.29.190.148:35339
Aug 12, 2026 12:29:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:29:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:29:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:29:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:29:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:29:11.534271 30458 mini_ranger.cc:160] Time spent starting Ranger: real 9.608s user 0.001s sys 0.068s
Aug 12, 2026 12:29:32 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:29:32 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 12:29:32 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:29:32 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:29:34 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:29:34.950343 30458 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.29.190.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.29.190.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/rangerkms_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/rangerkms_127.29.190.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.190.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.29.190.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.190.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/HTTP_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.190.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/HTTP_127.29.190.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:29:35 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494575, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:29:35.155103 30458 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:29:35.182348 30458 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:29:36.115697 30458 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:29:36.115890 30458 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms
I20260812 00:29:36.116024 30458 mini_ranger_kms.cc:227] Using postgres at 127.29.190.148:46945
2026-08-12 00:29:36,706 [I] DB FLAVOR :POSTGRES
2026-08-12 00:29:36,706 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:29:36,706 [I] Checking connection
2026-08-12 00:29:36,706 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:29:36,990 [I] connection success
2026-08-12 00:29:36,990 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:29:36,990 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:29:36,990 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:29:37,246 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:29:37,246 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:29:37,246 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:29:37,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:46945/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:29:37,552 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:29:38.066454 30458 mini_ranger_kms.cc:310] Created kms service
I20260812 00:29:38.284196 30458 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:29:38.333673 30458 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:29:38 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494575, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:29:38.812057 30458 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:29:38.812392 30458 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:29:38.812445 30458 mini_ranger_kms.cc:240] Using host: 127.29.190.148
I20260812 00:29:38.839231 30458 mini_ranger_kms.cc:276] Ranger KMS PID: 14992
I20260812 00:29:38.839485 30458 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.29.190.148:57031
Aug 12, 2026 12:29:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:29:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:29:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:29:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:29:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:29:40 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 00:29:40 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494580, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.190.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 00:29:41 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494580, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.190.148@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:29:41.730700 30458 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.576s user 0.144s sys 0.478s
I20260812 00:29:41.731108 30458 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:29:41.731365 30458 mini_ranger_kms.cc:401] 127.29.190.148:57031/kms/v1/keys
Aug 12 00:29:41 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494580, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.190.148@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
Aug 12 00:29:44 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:29:44.295929 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46507
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46507
--ranger_config_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:57031/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:29:44.658939 15064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:29:44.659252 15064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:29:44.659407 15064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:29:44.666747 15064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:29:44.666858 15064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:29:44.666904 15064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:29:44.667043 15064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:29:44.667114 15064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:29:44.677520 15064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/wal
--ranger_kms_url=127.29.190.148:57031/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46507
--ranger_config_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:29:44.678808 15064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:29:44.680109 15064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:29:44.694036 15072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:29:44.694095 15073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:29:44.694007 15076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:29:44.694726 15064 server_base.cc:1034] running on GCE node
I20260812 00:29:44.695784 15064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:29:44.697337 15064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:29:44.698630 15064 hybrid_clock.cc:648] HybridClock initialized: now 1786494584698596 us; error 54 us; skew 500 ppm
I20260812 00:29:44.699014 15064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:29:44 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494584, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:29:44.707597 15064 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:29:44.709360 15064 webserver.cc:460] Webserver started at http://127.29.190.190:46063/ using document root <none> and password file <none>
I20260812 00:29:44.710058 15064 fs_manager.cc:359] Metadata directory not provided
I20260812 00:29:44.710170 15064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:29:44.710435 15064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:29:44 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494584, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:29:44.769970 15064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "00f2033c61ff45419d0b16bf6cb61ef1"
format_stamp: "Formatted at 2026-08-12 00:29:44 on dist-test-slave-c12x"
server_key: "f55f01beb5e38b45fa44103850f6ab42"
server_key_iv: "bc9a3c3fbc52f6028d2e8be41b61aa73"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:44.771136 15064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "00f2033c61ff45419d0b16bf6cb61ef1"
format_stamp: "Formatted at 2026-08-12 00:29:44 on dist-test-slave-c12x"
server_key: "f55f01beb5e38b45fa44103850f6ab42"
server_key_iv: "bc9a3c3fbc52f6028d2e8be41b61aa73"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:44.778833 15064 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260812 00:29:44.801486 15087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:44.803346 15064 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:29:44.803593 15064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "00f2033c61ff45419d0b16bf6cb61ef1"
format_stamp: "Formatted at 2026-08-12 00:29:44 on dist-test-slave-c12x"
server_key: "f55f01beb5e38b45fa44103850f6ab42"
server_key_iv: "bc9a3c3fbc52f6028d2e8be41b61aa73"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:44.803874 15064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:29:44.830610 15064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:29:44.835139 15064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:29:44.835546 15064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:29:44.856752 15064 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46507
I20260812 00:29:44.856850 15166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46507 every 8 connection(s)
I20260812 00:29:44.858414 15064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:29:44.862033 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 15064
I20260812 00:29:44.862273 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:29:44.862972 30458 external_mini_cluster.cc:1428] Setting key df752b949fc9a16fd06e3a127adc8168
I20260812 00:29:44.863478 15167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:29:44.878798 15167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1: Bootstrap starting.
I20260812 00:29:44.882995 15167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1: Neither blocks nor log segments found. Creating new log.
I20260812 00:29:44.884509 15167 log.cc:824] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:29:44.888279 15167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1: No bootstrap required, opened a new log
Aug 12 00:29:44 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:29:44.900019 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:44.865396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53130 (local address 127.29.190.190:46507)
0812 00:29:44.877195 (+ 11799us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:44.877221 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:44.878181 (+ 960us) server_negotiation.cc:407] Connection header received
0812 00:29:44.880318 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:44.880344 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:44.880765 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:44.881199 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:29:44.882672 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:44.884232 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:44.886128 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:44.887260 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:44.887498 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:44.891789 (+ 4291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:29:44.891798 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:29:44.891816 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:29:44.891870 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:29:44.895238 (+ 3368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:44.896120 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:44.896129 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:44.896138 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:44.896310 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:44.896789 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:44.896801 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:44.896803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:44.897457 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:29:44.897816 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:44.898315 (+ 499us) server_negotiation.cc:299] Negotiation successful
0812 00:29:44.898839 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11393,"thread_start_us":11693,"threads_started":1}
I20260812 00:29:44.900128 15167 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f2033c61ff45419d0b16bf6cb61ef1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46507 } }
I20260812 00:29:44.900671 15167 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:29:44.900794 15167 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00f2033c61ff45419d0b16bf6cb61ef1, State: Initialized, Role: FOLLOWER
I20260812 00:29:44.901597 15167 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f2033c61ff45419d0b16bf6cb61ef1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46507 } }
I20260812 00:29:44.901989 15167 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:29:44.902148 15167 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:29:44.902346 15167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:29:44.906139 15167 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f2033c61ff45419d0b16bf6cb61ef1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46507 } }
I20260812 00:29:44.906807 15167 leader_election.cc:302] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00f2033c61ff45419d0b16bf6cb61ef1; no voters:
I20260812 00:29:44.907636 15167 leader_election.cc:288] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:29:44.907786 15172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:29:44.908753 15172 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [term 1 LEADER]: Becoming Leader. State: Replica: 00f2033c61ff45419d0b16bf6cb61ef1, State: Running, Role: LEADER
I20260812 00:29:44.910950 15172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f2033c61ff45419d0b16bf6cb61ef1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46507 } }
I20260812 00:29:44.913759 15173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00f2033c61ff45419d0b16bf6cb61ef1. Latest consensus state: current_term: 1 leader_uuid: "00f2033c61ff45419d0b16bf6cb61ef1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f2033c61ff45419d0b16bf6cb61ef1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46507 } } }
I20260812 00:29:44.914317 15173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:29:44.914758 15167 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:29:44.914637 15174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00f2033c61ff45419d0b16bf6cb61ef1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f2033c61ff45419d0b16bf6cb61ef1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46507 } } }
I20260812 00:29:44.915002 15174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:29:44.916429 15176 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:29:44.931675 15176 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:29:44.954197 15176 catalog_manager.cc:1347] Generated new cluster ID: 01e72841a99642a58182e590967f56c1
I20260812 00:29:44.954362 15176 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:29:44.967250 15176 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:29:44.969439 15176 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:29:44.981653 15176 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1: Generated new TSK 0
I20260812 00:29:44.982851 15176 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:29:44.990284 15167 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:29:45.863862 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46507
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:29:46 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494586, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 00:29:46.350231 15234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:29:46.350672 15234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:29:46.350894 15234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:29:46.361860 15234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:29:46.362089 15234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:29:46.362311 15234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:29:46.375749 15234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.29.190.148:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:29:46.377255 15234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:29:46.378665 15234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:29:46.397459 15249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:29:46.397610 15248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:29:46.397410 15253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:29:46.398274 15234 server_base.cc:1034] running on GCE node
I20260812 00:29:46.399204 15234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:29:46.400740 15234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:29:46.402014 15234 hybrid_clock.cc:648] HybridClock initialized: now 1786494586401954 us; error 42 us; skew 500 ppm
I20260812 00:29:46.402452 15234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:29:46 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494586, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:29:46.406966 15234 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:29:46.419881 15234 webserver.cc:460] Webserver started at http://127.29.190.129:39681/ using document root <none> and password file <none>
I20260812 00:29:46.421068 15234 fs_manager.cc:359] Metadata directory not provided
I20260812 00:29:46.421262 15234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:29:46.421680 15234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:29:46 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494586, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:29:46.456264 15234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "f7928186b5cb4b84a1841fd83faf5ea8"
format_stamp: "Formatted at 2026-08-12 00:29:46 on dist-test-slave-c12x"
server_key: "a9109fecb71bb5c200eef9ae75765d80"
server_key_iv: "df707ae0c92c6b5e1d06c63ef3ffb626"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:46.457646 15234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "f7928186b5cb4b84a1841fd83faf5ea8"
format_stamp: "Formatted at 2026-08-12 00:29:46 on dist-test-slave-c12x"
server_key: "a9109fecb71bb5c200eef9ae75765d80"
server_key_iv: "df707ae0c92c6b5e1d06c63ef3ffb626"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:46.470022 15234 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.003s sys 0.007s
I20260812 00:29:46.512195 15268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:46.514372 15234 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.004s sys 0.007s
I20260812 00:29:46.514714 15234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "f7928186b5cb4b84a1841fd83faf5ea8"
format_stamp: "Formatted at 2026-08-12 00:29:46 on dist-test-slave-c12x"
server_key: "a9109fecb71bb5c200eef9ae75765d80"
server_key_iv: "df707ae0c92c6b5e1d06c63ef3ffb626"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:46.515075 15234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:29:46.564514 15234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:29:46.570181 15234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:29:46.570560 15234 kserver.cc:163] Server-wide thread pool size limit: 3276
Aug 12 00:29:46 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494586, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:29:46.578013 15234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:29:46.584563 15234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:29:46.584712 15234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260812 00:29:46.584884 15234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:29:46.584959 15234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:46.697686 15234 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:36191
I20260812 00:29:46.697739 15435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:36191 every 8 connection(s)
I20260812 00:29:46.699843 15234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:29:46.709786 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 15234
I20260812 00:29:46.710048 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:29:46.710878 30458 external_mini_cluster.cc:1428] Setting key 833ab5c69d319fe82ac4d3845f5c77aa
Aug 12 00:29:46 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494586, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:29:46.735088 15439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:46.705081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46507 (local address 127.29.190.129:48767)
0812 00:29:46.706017 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0812 00:29:46.706073 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:29:46.708684 (+ 2611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:29:46.713347 (+ 4663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:29:46.713362 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:29:46.714060 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:29:46.715082 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:46.715112 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:46.717078 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:46.717084 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:46.719352 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:46.719381 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:46.720891 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:46.720902 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:46.721284 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:46.722277 (+ 993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:29:46.722314 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:29:46.725561 (+ 3247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:29:46.730036 (+ 4475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:29:46.730047 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:29:46.730067 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:29:46.730708 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:29:46.731211 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:29:46.731216 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:29:46.731220 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:29:46.731515 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:29:46.732276 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:29:46.732286 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:29:46.732743 (+ 457us) client_negotiation.cc:769] Sending connection context
0812 00:29:46.733076 (+ 333us) client_negotiation.cc:240] Negotiation successful
0812 00:29:46.733655 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":738,"threads_started":1}
I20260812 00:29:46.736302 15440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:46.705769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:48767 (local address 127.29.190.190:46507)
0812 00:29:46.712654 (+ 6885us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:46.712661 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:46.712682 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:29:46.712739 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:46.712745 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:46.712839 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:46.715305 (+ 2466us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:29:46.715589 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:46.716855 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:46.719628 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:46.720401 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:46.720588 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:46.725898 (+ 5310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:29:46.725914 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:29:46.725919 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:29:46.725979 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:29:46.729806 (+ 3827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:46.730877 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:46.730884 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:46.730889 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:46.731072 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:46.731653 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:46.731659 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:46.731662 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:46.732043 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:29:46.732177 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:46.735664 (+ 3487us) server_negotiation.cc:299] Negotiation successful
0812 00:29:46.735931 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6739,"thread_start_us":15231,"threads_started":1}
I20260812 00:29:46.738831 15436 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46507
I20260812 00:29:46.739203 15436 heartbeater.cc:464] Registering TS with master...
I20260812 00:29:46.740248 15436 heartbeater.cc:511] Master 127.29.190.190:46507 requested a full tablet report, sending...
I20260812 00:29:46.742954 15119 ts_manager.cc:194] Registered new tserver with Master: f7928186b5cb4b84a1841fd83faf5ea8 (127.29.190.129:36191)
I20260812 00:29:46.745214 15119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:48767
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:29:46.795562 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46507
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:29:46 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494586, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
W20260812 00:29:47.328848 15449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:29:47.329329 15449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:29:47.329564 15449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:29:47.341452 15449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:29:47.341621 15449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:29:47.341869 15449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:29:47.357995 15449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.29.190.148:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:29:47.360041 15449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:29:47.361799 15449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:29:47.389206 15471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:29:47.391599 15478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:29:47.396106 15475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:29:47.410004 15449 server_base.cc:1034] running on GCE node
I20260812 00:29:47.411002 15449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:29:47.412379 15449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:29:47.413738 15449 hybrid_clock.cc:648] HybridClock initialized: now 1786494587413635 us; error 74 us; skew 500 ppm
I20260812 00:29:47.414184 15449 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:29:47 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494587, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:29:47.418705 15449 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:29:47.431100 15449 webserver.cc:460] Webserver started at http://127.29.190.130:37883/ using document root <none> and password file <none>
I20260812 00:29:47.432303 15449 fs_manager.cc:359] Metadata directory not provided
I20260812 00:29:47.432544 15449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:29:47.433005 15449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:29:47 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494587, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:29:47.456904 15449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "56e369de8eca4e08b3d955c059407377"
format_stamp: "Formatted at 2026-08-12 00:29:47 on dist-test-slave-c12x"
server_key: "c31b101f2a553acd575b3f4b49b559b5"
server_key_iv: "75cbc298b8088bec1549e69f83049cc3"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:47.458102 15449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "56e369de8eca4e08b3d955c059407377"
format_stamp: "Formatted at 2026-08-12 00:29:47 on dist-test-slave-c12x"
server_key: "c31b101f2a553acd575b3f4b49b559b5"
server_key_iv: "75cbc298b8088bec1549e69f83049cc3"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:47.465545 15449 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.003s
I20260812 00:29:47.494002 15491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:47.496304 15449 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.004s sys 0.010s
I20260812 00:29:47.496549 15449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "56e369de8eca4e08b3d955c059407377"
format_stamp: "Formatted at 2026-08-12 00:29:47 on dist-test-slave-c12x"
server_key: "c31b101f2a553acd575b3f4b49b559b5"
server_key_iv: "75cbc298b8088bec1549e69f83049cc3"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:47.496866 15449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:29:47.518651 15449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:29:47.523533 15449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:29:47.523890 15449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:29:47.524976 15449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:29:47.526648 15449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:29:47.526760 15449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:47.526924 15449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:29:47.526999 15449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:47.568938 15449 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:39855
I20260812 00:29:47.569044 15674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:39855 every 8 connection(s)
I20260812 00:29:47.570444 15449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:29:47.572254 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 15449
I20260812 00:29:47.572453 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:29:47.573098 30458 external_mini_cluster.cc:1428] Setting key e9313a35007f10e77d711561639f739f
Aug 12 00:29:47 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494587, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
I20260812 00:29:47.618340 15678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:47.576107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46507 (local address 127.29.190.130:45043)
0812 00:29:47.594071 (+ 17964us) negotiation.cc:107] Waiting for socket to connect
0812 00:29:47.594140 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 00:29:47.596172 (+ 2032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:29:47.600652 (+ 4480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:29:47.600663 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:29:47.601279 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:29:47.601962 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:47.601983 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:47.603409 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:47.603414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:47.604973 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:47.604994 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:47.605843 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:47.605852 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:47.606097 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:47.606857 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:29:47.606882 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:29:47.609338 (+ 2456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:29:47.612931 (+ 3593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:29:47.612954 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:29:47.612969 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:29:47.613427 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:29:47.613839 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:29:47.613844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:29:47.613854 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:29:47.614079 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:29:47.614768 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:29:47.614777 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:29:47.615153 (+ 376us) client_negotiation.cc:769] Sending connection context
0812 00:29:47.615442 (+ 289us) client_negotiation.cc:240] Negotiation successful
0812 00:29:47.616500 (+ 1058us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17616,"thread_start_us":17003,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
I20260812 00:29:47.620425 15677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:47.575486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:45043 (local address 127.29.190.190:46507)
0812 00:29:47.599971 (+ 24485us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:47.599976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:47.599998 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:29:47.600059 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:47.600063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:47.600147 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:47.600306 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:29:47.602178 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:47.603231 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:47.605143 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:47.605574 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:47.605715 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:47.609613 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:29:47.609619 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:29:47.609622 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:29:47.609660 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:29:47.612769 (+ 3109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:47.613570 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:47.613576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:47.613580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:47.613721 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:47.614207 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:47.614213 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:47.614216 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:47.614623 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:29:47.614784 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:47.619757 (+ 4973us) server_negotiation.cc:299] Negotiation successful
0812 00:29:47.620043 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24358,"thread_start_us":24200,"threads_started":1}
I20260812 00:29:47.623930 15675 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46507
I20260812 00:29:47.624447 15675 heartbeater.cc:464] Registering TS with master...
I20260812 00:29:47.625471 15675 heartbeater.cc:511] Master 127.29.190.190:46507 requested a full tablet report, sending...
I20260812 00:29:47.627367 15119 ts_manager.cc:194] Registered new tserver with Master: 56e369de8eca4e08b3d955c059407377 (127.29.190.130:39855)
I20260812 00:29:47.628298 15119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:45043
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:29:47.659826 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46507
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:29:47.749436 15436 heartbeater.cc:503] Master 127.29.190.190:46507 was elected leader, sending a full tablet report...
W20260812 00:29:48.038116 15683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:29:48.038483 15683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:29:48.038659 15683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:29:48.046769 15683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:29:48.046962 15683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:29:48.047158 15683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:29:48.058024 15683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.29.190.148:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:29:48.059545 15683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:29:48.060907 15683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:29:48.074585 15692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:29:48.074623 15693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:29:48.074661 15698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:29:48.075940 15683 server_base.cc:1034] running on GCE node
I20260812 00:29:48.076575 15683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:29:48.077564 15683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:29:48.078809 15683 hybrid_clock.cc:648] HybridClock initialized: now 1786494588078761 us; error 61 us; skew 500 ppm
I20260812 00:29:48.079159 15683 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:29:48 dist-test-slave-c12x krb5kdc[14343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494588, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:29:48.082504 15683 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:29:48.084190 15683 webserver.cc:460] Webserver started at http://127.29.190.131:37671/ using document root <none> and password file <none>
I20260812 00:29:48.084925 15683 fs_manager.cc:359] Metadata directory not provided
I20260812 00:29:48.085081 15683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:29:48.085420 15683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:29:48 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494588, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:29:48.104743 15683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "9af33de1b0d84504b49ea1486ec34740"
format_stamp: "Formatted at 2026-08-12 00:29:48 on dist-test-slave-c12x"
server_key: "7470c3c61cbee84d9899af4378b59b56"
server_key_iv: "bea211fb15624c623b53cd1de678a71f"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:48.105671 15683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "9af33de1b0d84504b49ea1486ec34740"
format_stamp: "Formatted at 2026-08-12 00:29:48 on dist-test-slave-c12x"
server_key: "7470c3c61cbee84d9899af4378b59b56"
server_key_iv: "bea211fb15624c623b53cd1de678a71f"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:48.113157 15683 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.008s
I20260812 00:29:48.131685 15707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:48.133430 15683 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260812 00:29:48.133636 15683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "9af33de1b0d84504b49ea1486ec34740"
format_stamp: "Formatted at 2026-08-12 00:29:48 on dist-test-slave-c12x"
server_key: "7470c3c61cbee84d9899af4378b59b56"
server_key_iv: "bea211fb15624c623b53cd1de678a71f"
server_key_version: "kuduclusterkey@0"
I20260812 00:29:48.133882 15683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:29:48.168737 15683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:29:48.173152 15683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:29:48.173475 15683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:29:48.174600 15683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:29:48.176219 15683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:29:48.176297 15683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:48.176434 15683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:29:48.176489 15683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:29:48.212545 15683 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:40129
I20260812 00:29:48.212581 15884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:40129 every 8 connection(s)
I20260812 00:29:48.214087 15683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:29:48.223955 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 15683
I20260812 00:29:48.224135 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:29:48.224628 30458 external_mini_cluster.cc:1428] Setting key 5e5ae9ec3694c267b2b38569529fb17c
Aug 12 00:29:48 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494588, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:29:48.235378 15887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.216950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:37283 (local address 127.29.190.190:46507)
0812 00:29:48.217439 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.217443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.218424 (+ 981us) server_negotiation.cc:407] Connection header received
0812 00:29:48.220322 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.220327 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.220404 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.220504 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:29:48.222058 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.222833 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.224695 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.225352 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.225520 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.229557 (+ 4037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:29:48.229562 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:29:48.229565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:29:48.229598 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:29:48.232394 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.233182 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.233187 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.233190 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.233342 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.233815 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.233819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.233822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.234129 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:29:48.234250 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.234932 (+ 682us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.235105 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":230,"threads_started":1}
I20260812 00:29:48.236373 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.217538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46507 (local address 127.29.190.131:37283)
0812 00:29:48.218266 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0812 00:29:48.218303 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:29:48.220060 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:29:48.220708 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:29:48.220715 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:29:48.221245 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:29:48.221830 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.221847 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.222991 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.222995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.224526 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.224539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.225634 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.225640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.225962 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.226806 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:29:48.226839 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:29:48.229305 (+ 2466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:29:48.232549 (+ 3244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:29:48.232556 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:29:48.232569 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:29:48.233017 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:29:48.233463 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:29:48.233466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:29:48.233468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:29:48.233669 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:29:48.234244 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:29:48.234250 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:29:48.234577 (+ 327us) client_negotiation.cc:769] Sending connection context
0812 00:29:48.234805 (+ 228us) client_negotiation.cc:240] Negotiation successful
0812 00:29:48.235190 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":303,"threads_started":1}
I20260812 00:29:48.237919 15885 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46507
I20260812 00:29:48.238273 15885 heartbeater.cc:464] Registering TS with master...
I20260812 00:29:48.239305 15885 heartbeater.cc:511] Master 127.29.190.190:46507 requested a full tablet report, sending...
I20260812 00:29:48.240939 15119 ts_manager.cc:194] Registered new tserver with Master: 9af33de1b0d84504b49ea1486ec34740 (127.29.190.131:40129)
I20260812 00:29:48.241750 15119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:37283
I20260812 00:29:48.253176 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:29:48.271920 15887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.258134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36242 (local address 127.29.190.190:46507)
0812 00:29:48.258387 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.258399 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.258848 (+ 449us) server_negotiation.cc:407] Connection header received
0812 00:29:48.259037 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.259041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.259123 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.259210 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:29:48.260785 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.261569 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.262945 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.263411 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.263610 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.266201 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:29:48.266207 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:29:48.266210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:29:48.266245 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:29:48.268991 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.269794 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.269799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.269801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.269927 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.270351 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.270355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.270357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.270672 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:29:48.270871 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.271278 (+ 407us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.271564 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:29:48.276360 15119 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36242:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:29:48.283747 15119 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:29:48.310801 15916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.297979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36264 (local address 127.29.190.130:39855)
0812 00:29:48.300837 (+ 2858us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.300847 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.300878 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:29:48.300987 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.300994 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.301266 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.302352 (+ 1086us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:29:48.302660 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.304383 (+ 1723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.308292 (+ 3909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.309443 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.309704 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.309901 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.310233 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.310417 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2689,"thread_start_us":2569,"threads_started":1}
I20260812 00:29:48.311539 15909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.297167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39855 (local address 127.0.0.1:36264)
0812 00:29:48.298608 (+ 1441us) negotiation.cc:107] Waiting for socket to connect
0812 00:29:48.298647 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:29:48.298817 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:29:48.301538 (+ 2721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:29:48.301549 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:29:48.301585 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:29:48.302097 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.302115 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.304579 (+ 2464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.304584 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.308130 (+ 3546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.308142 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.309715 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.309722 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.309940 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.310048 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 00:29:48.310180 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 00:29:48.310433 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1153,"mutex_wait_us":665,"thread_start_us":2015,"threads_started":1}
I20260812 00:29:48.311813 15910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.297724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47326 (local address 127.29.190.129:36191)
0812 00:29:48.301089 (+ 3365us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.301096 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.301121 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:29:48.301208 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.301217 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.301422 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.301615 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:29:48.302661 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.304507 (+ 1846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.308006 (+ 3499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.309572 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.310712 (+ 1140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.310908 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.310981 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.311400 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3177,"thread_start_us":3054,"threads_started":1}
I20260812 00:29:48.311849 15905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.297542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:36191 (local address 127.0.0.1:47326)
0812 00:29:48.299520 (+ 1978us) negotiation.cc:107] Waiting for socket to connect
0812 00:29:48.299544 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:29:48.299681 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:29:48.301924 (+ 2243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:29:48.301948 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:29:48.301992 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:29:48.302429 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.302444 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.304653 (+ 2209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.304658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.307812 (+ 3154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.307829 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.309820 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.309826 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.310003 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.310044 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 00:29:48.310162 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 00:29:48.310440 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1789,"mutex_wait_us":97,"thread_start_us":676,"threads_started":1}
I20260812 00:29:48.316092 15571 tablet_service.cc:1467] Processing CreateTablet for tablet df7daf6eb7f848a6a4218759a1900044 (DEFAULT_TABLE table=test-table [id=9766380b8e144337b837e942a5f84df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:29:48.316699 15919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.300493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60882 (local address 127.29.190.131:40129)
0812 00:29:48.305881 (+ 5388us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.305893 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.306887 (+ 994us) server_negotiation.cc:407] Connection header received
0812 00:29:48.306999 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.307007 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.307282 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.307541 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:29:48.308338 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.310788 (+ 2450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.313823 (+ 3035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.315310 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.315553 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.315711 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.316125 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.316312 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5191,"thread_start_us":5010,"threads_started":1}
I20260812 00:29:48.316226 15342 tablet_service.cc:1467] Processing CreateTablet for tablet df7daf6eb7f848a6a4218759a1900044 (DEFAULT_TABLE table=test-table [id=9766380b8e144337b837e942a5f84df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:29:48.317396 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.300025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:40129 (local address 127.0.0.1:60882)
0812 00:29:48.306590 (+ 6565us) negotiation.cc:107] Waiting for socket to connect
0812 00:29:48.306609 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:29:48.306750 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:29:48.307518 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:29:48.307523 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:29:48.307551 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:29:48.308110 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.308124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.310975 (+ 2851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.310980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.313635 (+ 2655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.313650 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.315603 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.315609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.315831 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.315867 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:29:48.316882 (+ 1015us) client_negotiation.cc:240] Negotiation successful
0812 00:29:48.317041 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6369,"thread_start_us":6039,"threads_started":1}
I20260812 00:29:48.317523 15571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7daf6eb7f848a6a4218759a1900044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:29:48.317840 15342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7daf6eb7f848a6a4218759a1900044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:29:48.321384 15778 tablet_service.cc:1467] Processing CreateTablet for tablet df7daf6eb7f848a6a4218759a1900044 (DEFAULT_TABLE table=test-table [id=9766380b8e144337b837e942a5f84df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:29:48.323307 15778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7daf6eb7f848a6a4218759a1900044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:29:48.330977 15921 tablet_bootstrap.cc:492] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Bootstrap starting.
I20260812 00:29:48.334267 15921 tablet_bootstrap.cc:654] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Neither blocks nor log segments found. Creating new log.
I20260812 00:29:48.335366 15921 log.cc:824] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:29:48.337046 15923 tablet_bootstrap.cc:492] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: Bootstrap starting.
I20260812 00:29:48.339882 15925 tablet_bootstrap.cc:492] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Bootstrap starting.
I20260812 00:29:48.340173 15921 tablet_bootstrap.cc:492] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: No bootstrap required, opened a new log
I20260812 00:29:48.340487 15921 ts_tablet_manager.cc:1397] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260812 00:29:48.340878 15923 tablet_bootstrap.cc:654] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: Neither blocks nor log segments found. Creating new log.
I20260812 00:29:48.342231 15923 log.cc:824] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: Log is configured to *not* fsync() on all Append() calls
I20260812 00:29:48.343043 15925 tablet_bootstrap.cc:654] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Neither blocks nor log segments found. Creating new log.
I20260812 00:29:48.344201 15925 log.cc:824] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Log is configured to *not* fsync() on all Append() calls
I20260812 00:29:48.345561 15923 tablet_bootstrap.cc:492] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: No bootstrap required, opened a new log
I20260812 00:29:48.345837 15923 ts_tablet_manager.cc:1397] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260812 00:29:48.351166 15921 raft_consensus.cc:348] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.351667 15921 raft_consensus.cc:374] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:29:48.351776 15921 raft_consensus.cc:729] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7928186b5cb4b84a1841fd83faf5ea8, State: Initialized, Role: FOLLOWER
I20260812 00:29:48.352483 15921 consensus_queue.cc:260] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.353560 15925 tablet_bootstrap.cc:492] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: No bootstrap required, opened a new log
I20260812 00:29:48.353840 15925 ts_tablet_manager.cc:1397] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260812 00:29:48.354321 15921 ts_tablet_manager.cc:1428] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260812 00:29:48.356837 15923 raft_consensus.cc:348] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.357275 15923 raft_consensus.cc:374] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:29:48.357401 15923 raft_consensus.cc:729] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e369de8eca4e08b3d955c059407377, State: Initialized, Role: FOLLOWER
I20260812 00:29:48.358067 15923 consensus_queue.cc:260] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.359275 15675 heartbeater.cc:503] Master 127.29.190.190:46507 was elected leader, sending a full tablet report...
I20260812 00:29:48.359948 15923 ts_tablet_manager.cc:1428] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
I20260812 00:29:48.363706 15925 raft_consensus.cc:348] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.364112 15925 raft_consensus.cc:374] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:29:48.364185 15925 raft_consensus.cc:729] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af33de1b0d84504b49ea1486ec34740, State: Initialized, Role: FOLLOWER
I20260812 00:29:48.364707 15925 consensus_queue.cc:260] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.365849 15885 heartbeater.cc:503] Master 127.29.190.190:46507 was elected leader, sending a full tablet report...
I20260812 00:29:48.366577 15925 ts_tablet_manager.cc:1428] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260812 00:29:48.405272 15936 raft_consensus.cc:482] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:29:48.405755 15936 raft_consensus.cc:504] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.408010 15936 leader_election.cc:288] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56e369de8eca4e08b3d955c059407377 (127.29.190.130:39855), f7928186b5cb4b84a1841fd83faf5ea8 (127.29.190.129:36191)
I20260812 00:29:48.414904 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.408350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:36191 (local address 127.29.190.131:35197)
0812 00:29:48.408744 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0812 00:29:48.408768 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:29:48.408946 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:29:48.409456 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:29:48.409461 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:29:48.409583 (+ 122us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:29:48.409791 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.409803 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.411155 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.411160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.412770 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.412782 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.414111 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.414117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.414299 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.414335 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:29:48.414438 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:29:48.414572 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"spinlock_wait_cycles":27392}
I20260812 00:29:48.414947 15910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.408633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:35197 (local address 127.29.190.129:36191)
0812 00:29:48.408858 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.408864 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.408885 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:29:48.409136 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.409140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.409251 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.409441 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:29:48.410022 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.411026 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.412939 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.413960 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.414082 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.414135 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.414471 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.414651 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:29:48.415705 15938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.408466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:39855 (local address 127.29.190.131:40301)
0812 00:29:48.409323 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0812 00:29:48.409340 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:29:48.409514 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:29:48.410036 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:29:48.410040 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:29:48.410086 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:29:48.410466 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.410479 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.411820 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.411824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.413438 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:29:48.413452 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.414807 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.414814 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:29:48.415003 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.415040 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:29:48.415206 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 00:29:48.415332 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":506,"threads_started":1}
I20260812 00:29:48.415709 15916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.408351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:40301 (local address 127.29.190.130:39855)
0812 00:29:48.408605 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.408613 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.409449 (+ 836us) server_negotiation.cc:407] Connection header received
0812 00:29:48.409747 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.409753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.409831 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.409924 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:29:48.410642 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.411663 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.413594 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.414610 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.414752 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.414815 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.415244 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.415373 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:29:48.416169 15375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7daf6eb7f848a6a4218759a1900044" candidate_uuid: "9af33de1b0d84504b49ea1486ec34740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" is_pre_election: true
I20260812 00:29:48.416846 15375 raft_consensus.cc:2454] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9af33de1b0d84504b49ea1486ec34740 in term 0.
I20260812 00:29:48.416810 15602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7daf6eb7f848a6a4218759a1900044" candidate_uuid: "9af33de1b0d84504b49ea1486ec34740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e369de8eca4e08b3d955c059407377" is_pre_election: true
I20260812 00:29:48.417361 15602 raft_consensus.cc:2454] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9af33de1b0d84504b49ea1486ec34740 in term 0.
I20260812 00:29:48.417613 15708 leader_election.cc:302] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9af33de1b0d84504b49ea1486ec34740, f7928186b5cb4b84a1841fd83faf5ea8; no voters:
I20260812 00:29:48.418071 15936 raft_consensus.cc:2781] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:29:48.418233 15936 raft_consensus.cc:482] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:29:48.418346 15936 raft_consensus.cc:3037] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:29:48.420691 15936 raft_consensus.cc:504] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.421376 15936 leader_election.cc:288] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [CANDIDATE]: Term 1 election: Requested vote from peers 56e369de8eca4e08b3d955c059407377 (127.29.190.130:39855), f7928186b5cb4b84a1841fd83faf5ea8 (127.29.190.129:36191)
I20260812 00:29:48.422006 15375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7daf6eb7f848a6a4218759a1900044" candidate_uuid: "9af33de1b0d84504b49ea1486ec34740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7928186b5cb4b84a1841fd83faf5ea8"
I20260812 00:29:48.422078 15602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7daf6eb7f848a6a4218759a1900044" candidate_uuid: "9af33de1b0d84504b49ea1486ec34740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e369de8eca4e08b3d955c059407377"
I20260812 00:29:48.422254 15375 raft_consensus.cc:3037] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:29:48.422276 15602 raft_consensus.cc:3037] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:29:48.425617 15602 raft_consensus.cc:2454] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9af33de1b0d84504b49ea1486ec34740 in term 1.
I20260812 00:29:48.425617 15375 raft_consensus.cc:2454] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9af33de1b0d84504b49ea1486ec34740 in term 1.
I20260812 00:29:48.426115 15711 leader_election.cc:302] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e369de8eca4e08b3d955c059407377, 9af33de1b0d84504b49ea1486ec34740; no voters:
I20260812 00:29:48.426434 15936 raft_consensus.cc:2781] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:29:48.426936 15936 raft_consensus.cc:686] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 1 LEADER]: Becoming Leader. State: Replica: 9af33de1b0d84504b49ea1486ec34740, State: Running, Role: LEADER
I20260812 00:29:48.427479 15936 consensus_queue.cc:237] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } }
I20260812 00:29:48.432328 15117 catalog_manager.cc:5495] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9af33de1b0d84504b49ea1486ec34740 (127.29.190.131). New cstate: current_term: 1 leader_uuid: "9af33de1b0d84504b49ea1486ec34740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9af33de1b0d84504b49ea1486ec34740" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 40129 } health_report { overall_health: HEALTHY } } }
W20260812 00:29:48.456432 15438 tablet.cc:2369] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:29:48.465816 15886 tablet.cc:2369] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:29:48.474295 15919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.468581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.29.190.131:40129)
0812 00:29:48.468830 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.468834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.468852 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:29:48.468955 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.468958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.469039 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.469273 (+ 234us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:29:48.469780 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.470792 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.472323 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.472722 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.472819 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.473283 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:29:48.473806 (+ 523us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:29:48.473917 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.474031 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.474100 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:29:48.483073 15602 raft_consensus.cc:1261] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 1 FOLLOWER]: Refusing update from remote peer 9af33de1b0d84504b49ea1486ec34740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:29:48.483079 15375 raft_consensus.cc:1261] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 1 FOLLOWER]: Refusing update from remote peer 9af33de1b0d84504b49ea1486ec34740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:29:48.484163 15939 consensus_queue.cc:1035] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e369de8eca4e08b3d955c059407377" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 39855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:29:48.484570 15936 consensus_queue.cc:1035] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7928186b5cb4b84a1841fd83faf5ea8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 36191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:29:48.495219 15944 mvcc.cc:205] Tried to move back new op lower bound from 7317481834416738304 to 7317481834202972160. Current Snapshot: MvccSnapshot[applied={T|T < 7317481834416738304}]
I20260812 00:29:48.495219 15942 mvcc.cc:205] Tried to move back new op lower bound from 7317481834416738304 to 7317481834202972160. Current Snapshot: MvccSnapshot[applied={T|T < 7317481834416738304}]
I20260812 00:29:48.514014 15119 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36242:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:29:48.514344 15119 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36242:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:29:48.518316 15119 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 00f2033c61ff45419d0b16bf6cb61ef1: Sending DeleteTablet for 3 replicas of tablet df7daf6eb7f848a6a4218759a1900044
I20260812 00:29:48.519620 15571 tablet_service.cc:1514] Processing DeleteTablet for tablet df7daf6eb7f848a6a4218759a1900044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:29:48 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:36264
I20260812 00:29:48.520023 15342 tablet_service.cc:1514] Processing DeleteTablet for tablet df7daf6eb7f848a6a4218759a1900044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:29:48 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:47326
I20260812 00:29:48.520699 15957 tablet_replica.cc:330] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: stopping tablet replica
I20260812 00:29:48.520774 15778 tablet_service.cc:1514] Processing DeleteTablet for tablet df7daf6eb7f848a6a4218759a1900044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:29:48 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:60882
I20260812 00:29:48.520960 15961 tablet_replica.cc:330] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: stopping tablet replica
I20260812 00:29:48.521256 15957 raft_consensus.cc:2229] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:29:48.521358 15961 raft_consensus.cc:2229] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:29:48.521872 15961 raft_consensus.cc:2258] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:29:48.521893 15957 raft_consensus.cc:2258] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:29:48.523134 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 15234
I20260812 00:29:48.523952 15957 ts_tablet_manager.cc:1905] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:29:48.532313 15957 ts_tablet_manager.cc:1918] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:29:48.532527 15957 log.cc:1196] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/df7daf6eb7f848a6a4218759a1900044
I20260812 00:29:48.533121 15957 ts_tablet_manager.cc:1939] T df7daf6eb7f848a6a4218759a1900044 P 56e369de8eca4e08b3d955c059407377: Deleting consensus metadata
I20260812 00:29:48.533391 15961 ts_tablet_manager.cc:1905] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:29:48.535173 15094 catalog_manager.cc:4841] TS 56e369de8eca4e08b3d955c059407377 (127.29.190.130:39855): tablet df7daf6eb7f848a6a4218759a1900044 (table test-table [id=9766380b8e144337b837e942a5f84df3]) successfully deleted
I20260812 00:29:48.538895 15962 tablet_replica.cc:330] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: stopping tablet replica
I20260812 00:29:48.539397 15962 raft_consensus.cc:2229] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:29:48.540122 15962 raft_consensus.cc:2258] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:29:48.545557 15962 ts_tablet_manager.cc:1905] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:29:48.546545 15961 ts_tablet_manager.cc:1918] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:29:48.546752 15961 log.cc:1196] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/df7daf6eb7f848a6a4218759a1900044
Aug 12 00:29:48 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:29:48.547299 15961 ts_tablet_manager.cc:1939] T df7daf6eb7f848a6a4218759a1900044 P f7928186b5cb4b84a1841fd83faf5ea8: Deleting consensus metadata
I20260812 00:29:48.549468 15088 catalog_manager.cc:4841] TS f7928186b5cb4b84a1841fd83faf5ea8 (127.29.190.129:36191): tablet df7daf6eb7f848a6a4218759a1900044 (table test-table [id=9766380b8e144337b837e942a5f84df3]) successfully deleted
I20260812 00:29:48.552877 15962 ts_tablet_manager.cc:1918] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:29:48.553099 15962 log.cc:1196] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/df7daf6eb7f848a6a4218759a1900044
I20260812 00:29:48.553617 15962 ts_tablet_manager.cc:1939] T df7daf6eb7f848a6a4218759a1900044 P 9af33de1b0d84504b49ea1486ec34740: Deleting consensus metadata
I20260812 00:29:48.555266 15093 catalog_manager.cc:4841] TS 9af33de1b0d84504b49ea1486ec34740 (127.29.190.131:40129): tablet df7daf6eb7f848a6a4218759a1900044 (table test-table [id=9766380b8e144337b837e942a5f84df3]) successfully deleted
I20260812 00:29:48.556881 15910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.524358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47338 (local address 127.29.190.129:36191)
0812 00:29:48.524547 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.524553 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.535536 (+ 10983us) server_negotiation.cc:407] Connection header received
0812 00:29:48.535836 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.535843 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.535933 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.536052 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:29:48.538423 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.539591 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.541661 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.542331 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.542469 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.548564 (+ 6095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:29:48.548584 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:29:48.548604 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:29:48.548662 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:29:48.552900 (+ 4238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.554026 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.554038 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.554042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.554234 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.554778 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.554783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.554787 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.555292 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:29:48.555653 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.556126 (+ 473us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.556458 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:29:48.557582 15428 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:29:48.664299 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 15234
I20260812 00:29:48.691273 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 15449
Aug 12 00:29:48 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:29:48.707647 15916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.692187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36266 (local address 127.29.190.130:39855)
0812 00:29:48.692407 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.692413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.692435 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:29:48.692608 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.692614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.692693 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.692801 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:29:48.694099 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.694840 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.696380 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.696789 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.696950 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.701505 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:29:48.701522 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:29:48.701539 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:29:48.701578 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:29:48.704823 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.705498 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.705505 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.705508 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.705637 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.706034 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.706039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.706042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.706429 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:29:48.706732 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.707030 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.707251 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:29:48.708520 15664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:29:48.864589 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 15449
I20260812 00:29:48.901068 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 15683
Aug 12 00:29:48 dist-test-slave-c12x krb5kdc[14343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:29:48.920953 15919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:29:48.902027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60908 (local address 127.29.190.131:40129)
0812 00:29:48.902239 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:29:48.902246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:29:48.902274 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:29:48.902477 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:29:48.902485 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:29:48.902576 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:29:48.902727 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:29:48.904253 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.905495 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.906899 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:29:48.907908 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:29:48.908088 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:29:48.913208 (+ 5120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:29:48.913231 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:29:48.913260 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:29:48.913317 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:29:48.917647 (+ 4330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.918417 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.918428 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.918431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.918621 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:29:48.919037 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:29:48.919042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:29:48.919046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:29:48.919587 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:29:48.919954 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0812 00:29:48.920297 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 00:29:48.920544 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:29:48.921797 15879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:29:49.049221 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 15683
I20260812 00:29:49.073707 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 15064
I20260812 00:29:49.075115 15160 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:29:49.191059 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 15064
I20260812 00:29:49.222626 30458 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:29:49.568768 30458 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:29:49.569172 30458 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:29:49.916303 30458 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:29:49.916 UTC [14388] LOG: received smart shutdown request
2026-08-12 00:29:49.920 UTC [14388] LOG: background worker "logical replication launcher" (PID 14405) exited with exit code 1
2026-08-12 00:29:49.921 UTC [14393] LOG: shutting down
2026-08-12 00:29:50.096 UTC [14388] LOG: database system is shut down
2026-08-12T00:29:50Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53991 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:29:50 dist-test-slave-c12x krb5kdc[15983](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:29:50 dist-test-slave-c12x krb5kdc[15983](info): set up 2 sockets
Aug 12 00:29:50 dist-test-slave-c12x krb5kdc[15983](info): commencing operation
krb5kdc: starting...
W20260812 00:29:51.605175 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.010s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:29:51 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:29:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:29:51Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.29.190.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.29.190.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/rangeradmin_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/rangeradmin_127.29.190.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.29.190.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.29.190.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/rangerlookup_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/rangerlookup_127.29.190.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.190.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.29.190.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/HTTP_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/HTTP_127.29.190.148@KRBTEST.COM.keytab.
I20260812 00:29:51.992982 30458 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXieYLm/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/postgres -l logfile start
2026-08-12 00:29:54.611 UTC [16026] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 00:29:54.611 UTC [16026] LOG: listening on IPv4 address "127.29.190.148", port 44289
2026-08-12 00:29:54.615 UTC [16026] LOG: listening on Unix socket "/tmp/.s.PGSQL.44289"
2026-08-12 00:29:54.637 UTC [16030] LOG: database system was shut down at 2026-08-12 00:29:53 UTC
2026-08-12 00:29:54.641 UTC [16026] LOG: database system is ready to accept connections
I20260812 00:29:55.838166 30458 mini_postgres.cc:96] Postgres bound to 44289
2026-08-12 00:29:55.861 UTC [16047] FATAL: database "slave" does not exist
127.29.190.148:44289 - accepting connections
I20260812 00:29:55.861714 30458 mini_ranger.cc:161] Starting Ranger...
I20260812 00:29:55.894723 30458 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 00:29:56.406775 30458 mini_ranger.cc:87] Created ranger Postgres database
I20260812 00:29:56.406878 30458 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-admin
2026-08-12 00:29:56,719 [I] DB FLAVOR :POSTGRES
2026-08-12 00:29:56,719 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:29:56,719 [I] Checking connection..
2026-08-12 00:29:56,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 00:29:56,987 [I] Checking connection passed.
2026-08-12 00:29:56,987 [I] --------- Verifying version history table ---------
2026-08-12 00:29:56,987 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:29:57,261 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:29:57,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:29:57,545 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 00:29:57,545 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 00:29:57,545 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 00:29:57.799 UTC [16147] WARNING: there is no transaction in progress
2026-08-12 00:29:57,807 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 00:29:57,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 00:29:58,079 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 00:29:58,080 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:29:58,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 00:29:58,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 00:29:58,610 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-c12x.c.gcp-upstream.internal','N') ;"
2026-08-12 00:29:58,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:29:59,114 [I] Table x_portal_user does not exist in database ranger
2026-08-12 00:29:59,114 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:29:59,366 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 00:29:59,366 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:29:59,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:29:59,883 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 00:29:59,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 00:30:00.874 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:00.891 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:00.909 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:00.925 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:00.941 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:00.958 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.018 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.025 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.039 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.050 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.060 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.074 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.084 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.090 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.098 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01.105 UTC [16319] WARNING: there is no transaction in progress
2026-08-12 00:30:01,786 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 00:30:01,786 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 00:30:02,056 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 00:30:02,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 00:30:02,322 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 00:30:02,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 00:30:02,587 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 00:30:02,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 00:30:02,844 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 00:30:03,115 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-c12x.c.gcp-upstream.internal';"
2026-08-12 00:30:03,375 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 00:30:03,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 00:30:03,643 [I] DB_PATCHES have already been applied
I20260812 00:30:03.649801 30458 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXieYLm/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 00:30:03.649899 30458 mini_ranger.cc:193] Using host: 127.29.190.148
I20260812 00:30:03.669849 30458 mini_ranger.cc:227] Ranger admin URL: http://127.29.190.148:39777
Aug 12, 2026 12:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 12:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 12:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 12:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 12:30:04 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 00:30:05.094012 30458 mini_ranger.cc:160] Time spent starting Ranger: real 9.232s user 0.004s sys 0.053s
Aug 12, 2026 12:30:25 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 12:30:25 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 12:30:25 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 12:30:25 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 12:30:26 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 00:30:26.742558 30458 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.29.190.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.29.190.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/rangerkms_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.29.190.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/rangerkms_127.29.190.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.190.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.29.190.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.190.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/HTTP_127.29.190.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.190.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/HTTP_127.29.190.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 00:30:26 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494626, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 00:30:26.964293 30458 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 00:30:26.990675 30458 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 00:30:27.908838 30458 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 00:30:27.908972 30458 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms
I20260812 00:30:27.909032 30458 mini_ranger_kms.cc:227] Using postgres at 127.29.190.148:44289
2026-08-12 00:30:28,325 [I] DB FLAVOR :POSTGRES
2026-08-12 00:30:28,325 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 00:30:28,325 [I] Checking connection
2026-08-12 00:30:28,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 00:30:28,602 [I] connection success
2026-08-12 00:30:28,603 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 00:30:28,603 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 00:30:28,603 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 00:30:28,881 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 00:30:28,881 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 00:30:28,882 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 00:30:28,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.190.148:44289/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 00:30:29,161 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 00:30:29.650089 30458 mini_ranger_kms.cc:310] Created kms service
I20260812 00:30:29.850333 30458 mini_ranger_kms.cc:326] Created kudu user
I20260812 00:30:29.899580 30458 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 00:30:29 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494626, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:30.329032 30458 mini_ranger_kms.cc:384] Added ranger policy
I20260812 00:30:30.329386 30458 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXieYLm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXieYLm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 00:30:30.329432 30458 mini_ranger_kms.cc:240] Using host: 127.29.190.148
I20260812 00:30:30.351998 30458 mini_ranger_kms.cc:276] Ranger KMS PID: 16625
I20260812 00:30:30.352157 30458 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.29.190.148:55365
Aug 12, 2026 12:30:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 12:30:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 12:30:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 12:30:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 12:30:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 12:30:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 00:30:32 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494632, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.190.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 00:30:33 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494632, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.190.148@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:33.210951 30458 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.247s user 0.089s sys 0.363s
I20260812 00:30:33.211222 30458 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 00:30:33.211393 30458 mini_ranger_kms.cc:401] 127.29.190.148:55365/kms/v1/keys
Aug 12 00:30:33 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494632, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.190.148@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
Aug 12 00:30:35 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:30:36.032408 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46137
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46137
--ranger_config_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:55365/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:36.401311 16719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:36.401633 16719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:36.401724 16719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:36.408898 16719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:30:36.409013 16719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:36.409060 16719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:36.409132 16719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:30:36.409181 16719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:30:36.420081 16719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
--ranger_kms_url=127.29.190.148:55365/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46137
--ranger_config_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:36.421392 16719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:36.422696 16719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:36.435273 16724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:36.435256 16727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:36.435325 16729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:36.436062 16719 server_base.cc:1034] running on GCE node
I20260812 00:30:36.436959 16719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:36.438547 16719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:36.439790 16719 hybrid_clock.cc:648] HybridClock initialized: now 1786494636439750 us; error 35 us; skew 500 ppm
I20260812 00:30:36.440315 16719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:36 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494636, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:36.448746 16719 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:30:36.450392 16719 webserver.cc:460] Webserver started at http://127.29.190.190:39741/ using document root <none> and password file <none>
I20260812 00:30:36.451100 16719 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:36.451243 16719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:36.451637 16719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:30:36 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494636, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:36.511680 16719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "ec943c1669b5421ea661a3312392e682"
format_stamp: "Formatted at 2026-08-12 00:30:36 on dist-test-slave-c12x"
server_key: "a5385b5ca209e60cdb0151053d8d7a92"
server_key_iv: "e3f1e97e314dbb98345b3421f9de4a7e"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:36.512902 16719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "ec943c1669b5421ea661a3312392e682"
format_stamp: "Formatted at 2026-08-12 00:30:36 on dist-test-slave-c12x"
server_key: "a5385b5ca209e60cdb0151053d8d7a92"
server_key_iv: "e3f1e97e314dbb98345b3421f9de4a7e"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:36.520717 16719 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260812 00:30:36.541877 16742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:36.543926 16719 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:30:36.544217 16719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "ec943c1669b5421ea661a3312392e682"
format_stamp: "Formatted at 2026-08-12 00:30:36 on dist-test-slave-c12x"
server_key: "a5385b5ca209e60cdb0151053d8d7a92"
server_key_iv: "e3f1e97e314dbb98345b3421f9de4a7e"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:36.544489 16719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:36.564815 16719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:36.570362 16719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:36.570878 16719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:36.593307 16719 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46137
I20260812 00:30:36.593298 16837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46137 every 8 connection(s)
I20260812 00:30:36.594825 16719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:30:36.598767 16839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:36.603863 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 16719
I20260812 00:30:36.604099 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:30:36.604771 30458 external_mini_cluster.cc:1428] Setting key 8f1271768823cc26f12b7b2f17a750b8
I20260812 00:30:36.610222 16839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Bootstrap starting.
I20260812 00:30:36.614226 16839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:36.615635 16839 log.cc:824] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:36.619558 16839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: No bootstrap required, opened a new log
Aug 12 00:30:36 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:36.631119 16839 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } }
I20260812 00:30:36.631503 16844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:36.606871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59862 (local address 127.29.190.190:46137)
0812 00:30:36.607853 (+ 982us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:36.607869 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:36.607917 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:30:36.609629 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:36.609654 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:36.610046 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:36.610437 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:36.612255 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:36.613609 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:36.615636 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:36.616642 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:36.616870 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:36.621579 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:36.621595 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:36.621616 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:36.621669 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:36.625912 (+ 4243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:36.626744 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:36.626754 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:36.626764 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:36.626977 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:36.627404 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:36.627410 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:36.627414 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:36.628300 (+ 886us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:36.628671 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:36.629379 (+ 708us) server_negotiation.cc:299] Negotiation successful
0812 00:30:36.630060 (+ 681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":452,"threads_started":1}
I20260812 00:30:36.631690 16839 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:36.631804 16839 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec943c1669b5421ea661a3312392e682, State: Initialized, Role: FOLLOWER
I20260812 00:30:36.632436 16839 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } }
I20260812 00:30:36.632710 16839 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:30:36.632874 16839 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:30:36.633078 16839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:36.636247 16839 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } }
I20260812 00:30:36.636740 16839 leader_election.cc:302] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec943c1669b5421ea661a3312392e682; no voters:
I20260812 00:30:36.637276 16839 leader_election.cc:288] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:30:36.637431 16847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:30:36.638262 16847 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 1 LEADER]: Becoming Leader. State: Replica: ec943c1669b5421ea661a3312392e682, State: Running, Role: LEADER
I20260812 00:30:36.638825 16847 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } }
I20260812 00:30:36.639657 16839 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:30:36.641815 16849 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec943c1669b5421ea661a3312392e682. Latest consensus state: current_term: 1 leader_uuid: "ec943c1669b5421ea661a3312392e682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } } }
I20260812 00:30:36.642268 16849 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:36.643620 16848 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec943c1669b5421ea661a3312392e682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } } }
I20260812 00:30:36.643899 16855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:30:36.644008 16848 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:36.649691 16855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:30:36.650686 16839 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 00:30:36.670658 16855 catalog_manager.cc:1347] Generated new cluster ID: e3801a88210049b3ae4d47669d743c91
I20260812 00:30:36.670837 16855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:30:36.705010 16855 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:30:36.707269 16855 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:30:36.719240 16855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Generated new TSK 0
I20260812 00:30:36.720539 16855 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:30:37.475338 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:55365/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46137
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:30:37 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494637, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 00:30:37.939061 16905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:37.939626 16905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:37.939865 16905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:37.951661 16905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:37.951800 16905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:37.952036 16905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:30:37.967990 16905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.29.190.148:55365/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:37.969769 16905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:37.971549 16905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:37.990512 16933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:37.990621 16932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:37.998594 16905 server_base.cc:1034] running on GCE node
W20260812 00:30:37.998961 16935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:37.999914 16905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:38.001423 16905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:38.002740 16905 hybrid_clock.cc:648] HybridClock initialized: now 1786494638002676 us; error 49 us; skew 500 ppm
I20260812 00:30:38.003203 16905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:38 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494638, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:38.007758 16905 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:30:38.022202 16905 webserver.cc:460] Webserver started at http://127.29.190.129:42323/ using document root <none> and password file <none>
I20260812 00:30:38.023401 16905 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:38.023671 16905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:38.024104 16905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:30:38 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494638, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:38.049599 16905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "b056912e81a14f6e9332351c36652fe8"
format_stamp: "Formatted at 2026-08-12 00:30:38 on dist-test-slave-c12x"
server_key: "c82a4d984ec2545ce54382caa950a97e"
server_key_iv: "a44cf9fc78fda6ae82d1cb8a5db70548"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:38.050558 16905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "b056912e81a14f6e9332351c36652fe8"
format_stamp: "Formatted at 2026-08-12 00:30:38 on dist-test-slave-c12x"
server_key: "c82a4d984ec2545ce54382caa950a97e"
server_key_iv: "a44cf9fc78fda6ae82d1cb8a5db70548"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:38.057237 16905 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 00:30:38.097479 16944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:38.099756 16905 fs_manager.cc:725] Time spent opening block manager: real 0.027s user 0.011s sys 0.015s
I20260812 00:30:38.100070 16905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "b056912e81a14f6e9332351c36652fe8"
format_stamp: "Formatted at 2026-08-12 00:30:38 on dist-test-slave-c12x"
server_key: "c82a4d984ec2545ce54382caa950a97e"
server_key_iv: "a44cf9fc78fda6ae82d1cb8a5db70548"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:38.100479 16905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:38.192438 16905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:38.198259 16905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:38.198698 16905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:38.206278 16905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:38.214809 16905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:38.215008 16905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 00:30:38.215258 16905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:38.215402 16905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:30:38 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494637, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:38.591322 16905 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:33033
I20260812 00:30:38.593214 16905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:30:38.591039 17123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:33033 every 8 connection(s)
I20260812 00:30:38.598748 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 16905
I20260812 00:30:38.598989 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:30:38.599972 30458 external_mini_cluster.cc:1428] Setting key e20067b264e87e76cf69a8e0837a8354
Aug 12 00:30:38 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494638, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
I20260812 00:30:38.651448 17128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:38.607788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:55593 (local address 127.29.190.190:46137)
0812 00:30:38.610668 (+ 2880us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:38.610681 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:38.617527 (+ 6846us) server_negotiation.cc:407] Connection header received
0812 00:30:38.628221 (+ 10694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:38.628228 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:38.628343 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:38.628478 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:38.631231 (+ 2753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:38.632388 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:38.635583 (+ 3195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:38.636304 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:38.636439 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:38.641463 (+ 5024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:38.641471 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:38.641476 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:38.641522 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:38.645504 (+ 3982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:38.646825 (+ 1321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:38.646832 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:38.646836 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:38.646998 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:38.648792 (+ 1794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:38.648798 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:38.648801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:38.649259 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:38.649401 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:38.650726 (+ 1325us) server_negotiation.cc:299] Negotiation successful
0812 00:30:38.651004 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2720,"thread_start_us":2583,"threads_started":1}
I20260812 00:30:38.654244 17126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:38.604231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46137 (local address 127.29.190.129:55593)
0812 00:30:38.617249 (+ 13018us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:38.617330 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:38.627782 (+ 10452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:38.629318 (+ 1536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:38.629332 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:38.630056 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:38.630979 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:38.631010 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:38.632639 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:38.632644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:38.634787 (+ 2143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:38.634811 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:38.636864 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:38.636876 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:38.637189 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:38.637956 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:38.637988 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:38.641140 (+ 3152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:38.645722 (+ 4582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:38.645732 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:38.645754 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:38.646668 (+ 914us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:38.648341 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:38.648346 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:38.648350 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:38.648642 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:38.649523 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:38.649532 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:38.650125 (+ 593us) client_negotiation.cc:769] Sending connection context
0812 00:30:38.652087 (+ 1962us) client_negotiation.cc:240] Negotiation successful
0812 00:30:38.652728 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12633,"thread_start_us":15111,"threads_started":1}
I20260812 00:30:38.656705 17124 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46137
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
I20260812 00:30:38.657078 17124 heartbeater.cc:464] Registering TS with master...
Aug 12 00:30:38 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494637, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:38.658007 17124 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
I20260812 00:30:38.660964 16769 ts_manager.cc:194] Registered new tserver with Master: b056912e81a14f6e9332351c36652fe8 (127.29.190.129:33033)
I20260812 00:30:38.663578 16769 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:55593
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
W20260812 00:30:38.706466 30458 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.29.190.130: real 0.103s user 0.000s sys 0.023s
I20260812 00:30:38.707538 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:55365/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46137
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:39.161630 17136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:39.162024 17136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:39.162201 17136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:39.169996 17136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:39.170168 17136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:39.170346 17136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:30:39.181108 17136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.29.190.148:55365/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:39.182601 17136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:39.184139 17136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:39.199470 17156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:39.200022 17157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:39.199530 17159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:39.200752 17136 server_base.cc:1034] running on GCE node
I20260812 00:30:39.201560 17136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:39.202780 17136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:39.204033 17136 hybrid_clock.cc:648] HybridClock initialized: now 1786494639203966 us; error 43 us; skew 500 ppm
I20260812 00:30:39.204409 17136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:39 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494639, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:39.208509 17136 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:30:39.210399 17136 webserver.cc:460] Webserver started at http://127.29.190.130:35745/ using document root <none> and password file <none>
I20260812 00:30:39.211180 17136 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:39.211337 17136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:39.211745 17136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:30:39 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494639, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:39.229589 17136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "d63471aff84248cdb5b5f1d1e8caf421"
format_stamp: "Formatted at 2026-08-12 00:30:39 on dist-test-slave-c12x"
server_key: "572c4de63534b4635cd1b123548dc327"
server_key_iv: "b4425bc69ed1db033ab721e83d7dcbf8"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:39.230898 17136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "d63471aff84248cdb5b5f1d1e8caf421"
format_stamp: "Formatted at 2026-08-12 00:30:39 on dist-test-slave-c12x"
server_key: "572c4de63534b4635cd1b123548dc327"
server_key_iv: "b4425bc69ed1db033ab721e83d7dcbf8"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:39.238108 17136 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.003s
I20260812 00:30:39.256201 17168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:39.257745 17136 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 00:30:39.257956 17136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "d63471aff84248cdb5b5f1d1e8caf421"
format_stamp: "Formatted at 2026-08-12 00:30:39 on dist-test-slave-c12x"
server_key: "572c4de63534b4635cd1b123548dc327"
server_key_iv: "b4425bc69ed1db033ab721e83d7dcbf8"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:39.258208 17136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:39.280959 17136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:39.285382 17136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:39.285720 17136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:39.286764 17136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:39.288367 17136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:39.288475 17136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:39.288638 17136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:39.288715 17136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:39.329773 17136 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:36955
I20260812 00:30:39.329835 17337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:36955 every 8 connection(s)
I20260812 00:30:39.331111 17136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:30:39.333518 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 17136
I20260812 00:30:39.333714 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:30:39.334285 30458 external_mini_cluster.cc:1428] Setting key 7d0667cc1f1e9e4976fb9b097ea7e90d
Aug 12 00:30:39 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494639, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:39.353880 17342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:39.333923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:42125 (local address 127.29.190.190:46137)
0812 00:30:39.334489 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:39.334495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:39.335672 (+ 1177us) server_negotiation.cc:407] Connection header received
0812 00:30:39.337854 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:39.337862 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:39.337953 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:39.338080 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:39.339559 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.340817 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.342450 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.343204 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.343350 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:39.347547 (+ 4197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:39.347553 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:39.347557 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:39.347590 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:39.350402 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:39.351398 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:39.351402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:39.351404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:39.351588 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:39.352142 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:39.352146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:39.352148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:39.352417 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:39.352538 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:39.353415 (+ 877us) server_negotiation.cc:299] Negotiation successful
0812 00:30:39.353603 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":280,"threads_started":1}
I20260812 00:30:39.355500 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:39.334480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46137 (local address 127.29.190.130:42125)
0812 00:30:39.335422 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:39.335539 (+ 117us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:39.337564 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:39.338291 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:39.338299 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:39.338749 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:39.339331 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:39.339348 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.341049 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.341056 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:39.342298 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:39.342310 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.343531 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.343539 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:39.343760 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:39.344537 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:39.344569 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:39.347268 (+ 2699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:39.350572 (+ 3304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:39.350584 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:39.350607 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:39.351273 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:39.351700 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:39.351708 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:39.351715 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:39.352026 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:39.352543 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:39.352553 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:39.353015 (+ 462us) client_negotiation.cc:769] Sending connection context
0812 00:30:39.353331 (+ 316us) client_negotiation.cc:240] Negotiation successful
0812 00:30:39.353925 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":385,"threads_started":1}
I20260812 00:30:39.357226 17340 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46137
I20260812 00:30:39.357563 17340 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:39.358305 17340 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
I20260812 00:30:39.359978 16769 ts_manager.cc:194] Registered new tserver with Master: d63471aff84248cdb5b5f1d1e8caf421 (127.29.190.130:36955)
I20260812 00:30:39.361295 16769 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:42125
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:30:39.399565 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:55365/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46137
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:30:39.668147 17124 heartbeater.cc:503] Master 127.29.190.190:46137 was elected leader, sending a full tablet report...
W20260812 00:30:39.764557 17348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:39.764839 17348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:39.764998 17348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:39.772492 17348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:39.772607 17348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:39.772831 17348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:30:39.782585 17348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.29.190.148:55365/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:39.783977 17348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:39.785315 17348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:39.799252 17356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:39.799171 17361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:39.799211 17357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:39.800537 17348 server_base.cc:1034] running on GCE node
I20260812 00:30:39.801196 17348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:39.802196 17348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:39.803521 17348 hybrid_clock.cc:648] HybridClock initialized: now 1786494639803467 us; error 53 us; skew 500 ppm
I20260812 00:30:39.803860 17348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:39 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494639, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:39.807274 17348 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:30:39.808893 17348 webserver.cc:460] Webserver started at http://127.29.190.131:43947/ using document root <none> and password file <none>
I20260812 00:30:39.809641 17348 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:39.809806 17348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:39.810146 17348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 00:30:39 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494639, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:39.827138 17348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "b294110c9d5647428d505eb7775a4b19"
format_stamp: "Formatted at 2026-08-12 00:30:39 on dist-test-slave-c12x"
server_key: "be66bb327cbeffc7ba2d18d9434e0e4d"
server_key_iv: "63f031a663d734f14577b43e702bc665"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:39.828289 17348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "b294110c9d5647428d505eb7775a4b19"
format_stamp: "Formatted at 2026-08-12 00:30:39 on dist-test-slave-c12x"
server_key: "be66bb327cbeffc7ba2d18d9434e0e4d"
server_key_iv: "63f031a663d734f14577b43e702bc665"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:39.835244 17348 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:30:39.851934 17369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:39.853736 17348 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260812 00:30:39.853925 17348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "b294110c9d5647428d505eb7775a4b19"
format_stamp: "Formatted at 2026-08-12 00:30:39 on dist-test-slave-c12x"
server_key: "be66bb327cbeffc7ba2d18d9434e0e4d"
server_key_iv: "63f031a663d734f14577b43e702bc665"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:39.854231 17348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:39.873924 17348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:39.878036 17348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:39.878300 17348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:39.879242 17348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:39.880716 17348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:39.880793 17348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:39.880878 17348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:39.880926 17348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:39.917032 17348 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:38307
I20260812 00:30:39.917068 17544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:38307 every 8 connection(s)
I20260812 00:30:39.918505 17348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:30:39.928177 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 17348
I20260812 00:30:39.928362 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:30:39.929075 30458 external_mini_cluster.cc:1428] Setting key 944c91185694d5ed900732f369642467
Aug 12 00:30:39 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494639, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:39.939177 17547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:39.921258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:54885 (local address 127.29.190.190:46137)
0812 00:30:39.921746 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:39.921754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:39.922747 (+ 993us) server_negotiation.cc:407] Connection header received
0812 00:30:39.924634 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:39.924638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:39.924710 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:39.924804 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:39.926176 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.926897 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.928647 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.929336 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.929480 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:39.933037 (+ 3557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:39.933042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:39.933045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:39.933079 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:39.935936 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:39.936815 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:39.936821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:39.936824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:39.936957 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:39.937426 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:39.937434 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:39.937441 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:39.937718 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:39.937879 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:39.938563 (+ 684us) server_negotiation.cc:299] Negotiation successful
0812 00:30:39.938799 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":219,"threads_started":1}
I20260812 00:30:39.940260 17549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:39.921846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46137 (local address 127.29.190.131:54885)
0812 00:30:39.922577 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:39.922623 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:39.924340 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:39.925008 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:39.925015 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:39.925427 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:39.926014 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:39.926032 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.927029 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.927033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:39.928464 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:39.928490 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.929555 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.929560 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:39.929749 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:39.930505 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:39.930530 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:39.932801 (+ 2271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:39.936112 (+ 3311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:39.936121 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:39.936140 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:39.936683 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:39.937078 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:39.937083 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:39.937086 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:39.937301 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:39.937860 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:39.937868 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:39.938200 (+ 332us) client_negotiation.cc:769] Sending connection context
0812 00:30:39.938469 (+ 269us) client_negotiation.cc:240] Negotiation successful
0812 00:30:39.939009 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":309,"threads_started":1}
I20260812 00:30:39.941800 17545 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46137
I20260812 00:30:39.942169 17545 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:39.943149 17545 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
I20260812 00:30:39.945364 16767 ts_manager.cc:194] Registered new tserver with Master: b294110c9d5647428d505eb7775a4b19 (127.29.190.131:38307)
I20260812 00:30:39.946393 16767 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:54885
I20260812 00:30:39.957783 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:30:39.959709 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 16905
Aug 12 00:30:39 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:30:39.977102 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:39.960818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52464 (local address 127.29.190.129:33033)
0812 00:30:39.961541 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:39.961548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:39.961576 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:30:39.961635 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:39.961642 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:39.961849 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:39.961988 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:39.963592 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.964659 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.966124 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:39.966705 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:39.966805 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:39.971110 (+ 4305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:39.971124 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:39.971141 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:39.971186 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:39.974149 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:39.974904 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:39.974911 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:39.974913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:39.975061 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:39.975563 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:39.975566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:39.975568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:39.975933 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:39.976171 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:39.976459 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 00:30:39.976693 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":353,"threads_started":1}
I20260812 00:30:39.978483 17116 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:40.063951 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 16905
I20260812 00:30:40.088802 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 17136
Aug 12 00:30:40 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:30:40.110246 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:40.089808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46400 (local address 127.29.190.130:36955)
0812 00:30:40.090378 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:40.090386 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:40.090414 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:30:40.090479 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:40.090485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:40.090722 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:40.090858 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:40.092251 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:40.093322 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:40.094642 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:40.095175 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:40.095273 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:40.104391 (+ 9118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:40.104406 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:40.104422 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:40.104462 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:40.107552 (+ 3090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:40.108278 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:40.108286 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:40.108288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:40.108420 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:40.108747 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:40.108750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:40.108752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:40.109092 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:40.109338 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:40.109702 (+ 364us) server_negotiation.cc:299] Negotiation successful
0812 00:30:40.109934 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":309,"threads_started":1}
I20260812 00:30:40.111826 17331 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:40.195482 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 17136
I20260812 00:30:40.219419 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 17348
Aug 12 00:30:40 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:30:40.237914 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:40.220674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45054 (local address 127.29.190.131:38307)
0812 00:30:40.221389 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:40.221399 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:40.221444 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:30:40.221512 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:40.221518 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:40.221753 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:40.221883 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:40.223264 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:40.224527 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:40.225855 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:40.226485 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:40.226597 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:40.231639 (+ 5042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:40.231654 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:40.231671 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:40.231714 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:40.234737 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:40.235659 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:40.235668 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:40.235671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:40.235809 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:40.236207 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:40.236210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:40.236212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:40.236582 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:40.236831 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:40.237303 (+ 472us) server_negotiation.cc:299] Negotiation successful
0812 00:30:40.237605 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":385,"threads_started":1}
I20260812 00:30:40.239311 17537 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:40.325871 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 17348
I20260812 00:30:40.349452 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 16719
I20260812 00:30:40.350728 16830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:40.457095 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 16719
I20260812 00:30:40.487201 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46137
--webserver_interface=127.29.190.190
--webserver_port=39741
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46137
--ranger_config_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:55365/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.190.148:55365/kms with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:40.841236 17562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:40.841553 17562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:40.841719 17562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:40.848937 17562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:30:40.849045 17562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:40.849159 17562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:40.849274 17562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:30:40.849370 17562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:30:40.859400 17562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.190.148:55365/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46137
--ranger_config_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=39741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:40.860836 17562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:40.862689 17562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:40.874598 17568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:40.874536 17571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:40.874660 17569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:40.875638 17562 server_base.cc:1034] running on GCE node
I20260812 00:30:40.876524 17562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:40.878010 17562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:40.879262 17562 hybrid_clock.cc:648] HybridClock initialized: now 1786494640879225 us; error 56 us; skew 500 ppm
I20260812 00:30:40.879690 17562 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:40 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494640, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:40.882838 17562 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:30:40.884490 17562 webserver.cc:460] Webserver started at http://127.29.190.190:39741/ using document root <none> and password file <none>
I20260812 00:30:40.885164 17562 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:40.885319 17562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:30:40 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494640, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:40.944679 17562 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:30:40.947999 17583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:40.949530 17562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 00:30:40.949755 17562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "ec943c1669b5421ea661a3312392e682"
format_stamp: "Formatted at 2026-08-12 00:30:36 on dist-test-slave-c12x"
server_key: "a5385b5ca209e60cdb0151053d8d7a92"
server_key_iv: "e3f1e97e314dbb98345b3421f9de4a7e"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:40.950783 17562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:40.967684 17562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:40.971602 17562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:40.971915 17562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:40.991772 17562 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46137
I20260812 00:30:40.991796 17663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46137 every 8 connection(s)
I20260812 00:30:40.993377 17562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:30:40.996838 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 17562
I20260812 00:30:40.997738 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:55365/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:33033
--local_ip_for_outbound_sockets=127.29.190.129
--tserver_master_addrs=127.29.190.190:46137
--webserver_port=42323
--webserver_interface=127.29.190.129
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.190.148:55365/kms with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:30:41.000787 17664 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:30:41.004184 17664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Bootstrap starting.
I20260812 00:30:41.026998 17664 log.cc:824] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:41.036278 17664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:30:41.036865 17664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Bootstrap complete.
I20260812 00:30:41.046098 17664 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } }
I20260812 00:30:41.047004 17664 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec943c1669b5421ea661a3312392e682, State: Initialized, Role: FOLLOWER
I20260812 00:30:41.047791 17664 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } }
I20260812 00:30:41.048043 17664 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:30:41.048172 17664 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:30:41.048372 17664 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:30:41.052410 17664 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } }
I20260812 00:30:41.052956 17664 leader_election.cc:302] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec943c1669b5421ea661a3312392e682; no voters:
I20260812 00:30:41.053776 17664 leader_election.cc:288] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:30:41.053928 17671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:30:41.055115 17671 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [term 2 LEADER]: Becoming Leader. State: Replica: ec943c1669b5421ea661a3312392e682, State: Running, Role: LEADER
I20260812 00:30:41.055859 17671 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } }
I20260812 00:30:41.056325 17664 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:30:41.058997 17674 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec943c1669b5421ea661a3312392e682. Latest consensus state: current_term: 2 leader_uuid: "ec943c1669b5421ea661a3312392e682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } } }
I20260812 00:30:41.059079 17673 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ec943c1669b5421ea661a3312392e682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec943c1669b5421ea661a3312392e682" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46137 } } }
I20260812 00:30:41.059480 17674 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:41.059545 17673 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682 [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:41.063687 17686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:30:41.076807 17686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:30:41.078964 17686 catalog_manager.cc:1259] Loaded cluster ID: e3801a88210049b3ae4d47669d743c91
I20260812 00:30:41.079192 17686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:30:41.083936 17686 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:30:41.085726 17686 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Loaded TSK: 0
I20260812 00:30:41.087553 17686 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:30:41.091394 17664 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260812 00:30:41.490005 17667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:41.490378 17667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:41.490604 17667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:41.499024 17667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:41.499200 17667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:41.499408 17667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:30:41.513247 17667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.190.148:55365/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:33033
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=42323
--tserver_master_addrs=127.29.190.190:46137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:41.515190 17667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:41.517138 17667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:41.543784 17725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:41.550293 17722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:41.559612 17667 server_base.cc:1034] running on GCE node
W20260812 00:30:41.559957 17729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:41.560845 17667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:41.562132 17667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:41.565636 17667 hybrid_clock.cc:648] HybridClock initialized: now 1786494641565543 us; error 69 us; skew 500 ppm
I20260812 00:30:41.566103 17667 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:41 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494641, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:41.574100 17667 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:30:41.576428 17667 webserver.cc:460] Webserver started at http://127.29.190.129:42323/ using document root <none> and password file <none>
I20260812 00:30:41.577343 17667 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:41.577526 17667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:30:41 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494641, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:41.616971 17667 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.001s
I20260812 00:30:41.646191 17740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:41.648497 17667 fs_manager.cc:725] Time spent opening block manager: real 0.029s user 0.005s sys 0.001s
I20260812 00:30:41.648746 17667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "b056912e81a14f6e9332351c36652fe8"
format_stamp: "Formatted at 2026-08-12 00:30:38 on dist-test-slave-c12x"
server_key: "c82a4d984ec2545ce54382caa950a97e"
server_key_iv: "a44cf9fc78fda6ae82d1cb8a5db70548"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:41.650349 17667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:41.685245 17667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:41.691092 17667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:41.691486 17667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:41.700773 17667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:41.703084 17667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:41.703219 17667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:41.703493 17667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:41.703665 17667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:41.768013 17667 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:33033
I20260812 00:30:41.768052 17917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:33033 every 8 connection(s)
I20260812 00:30:41.769922 17667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:30:41.773207 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 17667
I20260812 00:30:41.774076 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:55365/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:36955
--local_ip_for_outbound_sockets=127.29.190.130
--tserver_master_addrs=127.29.190.190:46137
--webserver_port=35745
--webserver_interface=127.29.190.130
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.190.148:55365/kms with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:30:41 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494641, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:41.823828 17921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:41.773559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:39133 (local address 127.29.190.190:46137)
0812 00:30:41.788140 (+ 14581us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:41.788166 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:41.792183 (+ 4017us) server_negotiation.cc:407] Connection header received
0812 00:30:41.796097 (+ 3914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:41.796126 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:41.796693 (+ 567us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:41.797129 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:41.800159 (+ 3030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:41.802474 (+ 2315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:41.805505 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:41.806783 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:41.806994 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:41.812616 (+ 5622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:41.812633 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:41.812660 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:41.812726 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:41.817421 (+ 4695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:41.818660 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:41.818673 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:41.818682 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:41.818958 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:41.819637 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:41.819644 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:41.819648 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:41.820420 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:41.820649 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:41.821931 (+ 1282us) server_negotiation.cc:299] Negotiation successful
0812 00:30:41.822396 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14202,"thread_start_us":17181,"threads_started":1}
I20260812 00:30:41.823822 17923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:41.773609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46137 (local address 127.29.190.129:39133)
0812 00:30:41.791913 (+ 18304us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:41.791992 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:41.795119 (+ 3127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:41.798138 (+ 3019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:41.798153 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:41.798935 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:41.799887 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:41.799919 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:41.802768 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:41.802777 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:41.805247 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:41.805284 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:41.807627 (+ 2343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:41.807637 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:41.808009 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:41.808982 (+ 973us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:41.809027 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:41.812198 (+ 3171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:41.817691 (+ 5493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:41.817702 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:41.817721 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:41.818425 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:41.819116 (+ 691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:41.819122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:41.819127 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:41.819476 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:41.820744 (+ 1268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:41.820753 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:41.821233 (+ 480us) client_negotiation.cc:769] Sending connection context
0812 00:30:41.821606 (+ 373us) client_negotiation.cc:240] Negotiation successful
0812 00:30:41.822295 (+ 689us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17918,"thread_start_us":19533,"threads_started":1}
I20260812 00:30:41.828475 17919 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46137
I20260812 00:30:41.828877 17919 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:41.829898 17919 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
W20260812 00:30:41.834052 17919 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:46137 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:30:41.834327 17919 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:41.834657 17919 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
I20260812 00:30:41.836293 17919 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:41.836694 17919 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
W20260812 00:30:41.837997 17919 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:30:42.212939 17925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:42.213322 17925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:42.213510 17925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:42.223093 17925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:42.223204 17925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:42.223376 17925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:30:42.234760 17925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.190.148:55365/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:36955
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=35745
--tserver_master_addrs=127.29.190.190:46137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:42.236317 17925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:42.237697 17925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:42.257153 17945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:42.256721 17944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:42.263044 17947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:42.263566 17925 server_base.cc:1034] running on GCE node
I20260812 00:30:42.264302 17925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:42.265411 17925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:42.266681 17925 hybrid_clock.cc:648] HybridClock initialized: now 1786494642266615 us; error 36 us; skew 500 ppm
I20260812 00:30:42.267056 17925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:42 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494642, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:42.270546 17925 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:30:42.272380 17925 webserver.cc:460] Webserver started at http://127.29.190.130:35745/ using document root <none> and password file <none>
I20260812 00:30:42.273339 17925 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:42.273622 17925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:30:42 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494642, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:42.314522 17925 fs_manager.cc:709] Time spent opening directory manager: real 0.021s user 0.007s sys 0.010s
I20260812 00:30:42.324143 17956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:42.326469 17925 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.005s sys 0.003s
I20260812 00:30:42.326687 17925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "d63471aff84248cdb5b5f1d1e8caf421"
format_stamp: "Formatted at 2026-08-12 00:30:39 on dist-test-slave-c12x"
server_key: "572c4de63534b4635cd1b123548dc327"
server_key_iv: "b4425bc69ed1db033ab721e83d7dcbf8"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:42.328233 17925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:42.388087 17925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:42.393383 17925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:42.393728 17925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:42.398144 17925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:42.399983 17925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:42.400120 17925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:42.400265 17925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:42.400357 17925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 00:30:42 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786494642, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:42.499400 17925 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:36955
I20260812 00:30:42.499490 18134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:36955 every 8 connection(s)
I20260812 00:30:42.501334 17925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:30:42.511714 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 17925
I20260812 00:30:42.512637 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.190.148:55365/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:38307
--local_ip_for_outbound_sockets=127.29.190.131
--tserver_master_addrs=127.29.190.190:46137
--webserver_port=43947
--webserver_interface=127.29.190.131
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.190.148:55365/kms with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:30:42 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494642, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:42.578275 18139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:42.506395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:57287 (local address 127.29.190.190:46137)
0812 00:30:42.547162 (+ 40767us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:42.547173 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:42.551515 (+ 4342us) server_negotiation.cc:407] Connection header received
0812 00:30:42.554774 (+ 3259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:42.554783 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:42.554897 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:42.555024 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:42.557816 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:42.559117 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:42.562123 (+ 3006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:42.562932 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:42.563073 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:42.568552 (+ 5479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:42.568560 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:42.568565 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:42.568616 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:42.572852 (+ 4236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:42.574184 (+ 1332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:42.574193 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:42.574200 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:42.574387 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:42.575532 (+ 1145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:42.575541 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:42.575547 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:42.576053 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:42.576235 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:42.577540 (+ 1305us) server_negotiation.cc:299] Negotiation successful
0812 00:30:42.577818 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40518,"thread_start_us":45256,"threads_started":1}
I20260812 00:30:42.581099 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:42.504964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46137 (local address 127.29.190.130:57287)
0812 00:30:42.549165 (+ 44201us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:42.549240 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:42.553542 (+ 4302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:42.555777 (+ 2235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:42.555793 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:42.556541 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:42.557555 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:42.557590 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:42.559345 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:42.559353 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:42.561890 (+ 2537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:42.561924 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:42.563537 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:42.563548 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:42.563934 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:42.564844 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:42.564881 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:42.568138 (+ 3257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:42.573126 (+ 4988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:42.573139 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:42.573162 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:42.573982 (+ 820us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:42.574557 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:42.574563 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:42.574567 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:42.574899 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:42.576324 (+ 1425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:42.576336 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:42.576997 (+ 661us) client_negotiation.cc:769] Sending connection context
0812 00:30:42.578977 (+ 1980us) client_negotiation.cc:240] Negotiation successful
0812 00:30:42.579656 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40924,"thread_start_us":42148,"threads_started":1}
I20260812 00:30:42.583241 18135 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46137
I20260812 00:30:42.583660 18135 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:42.584662 18135 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
I20260812 00:30:42.586894 17610 ts_manager.cc:194] Registered new tserver with Master: d63471aff84248cdb5b5f1d1e8caf421 (127.29.190.130:36955)
I20260812 00:30:42.589259 17610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:57287
I20260812 00:30:42.838155 17919 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:42.838641 17919 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
I20260812 00:30:42.840791 17610 ts_manager.cc:194] Registered new tserver with Master: b056912e81a14f6e9332351c36652fe8 (127.29.190.129:33033)
I20260812 00:30:42.842073 17610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:39133
Aug 12 00:30:42 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494642, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
W20260812 00:30:43.048739 18141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:43.049222 18141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:43.049381 18141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:43.060925 18141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:43.061082 18141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:43.061265 18141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:30:43.076961 18141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.190.148:55365/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:38307
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=43947
--tserver_master_addrs=127.29.190.190:46137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:43.078687 18141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:43.080729 18141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:43.124076 18152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:43.131984 18151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:43.132265 18158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:43.132711 18141 server_base.cc:1034] running on GCE node
I20260812 00:30:43.133833 18141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:43.141288 18141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:43.142618 18141 hybrid_clock.cc:648] HybridClock initialized: now 1786494643142541 us; error 86 us; skew 500 ppm
I20260812 00:30:43.143042 18141 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:43 dist-test-slave-c12x krb5kdc[15983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494643, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:43.147485 18141 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:30:43.175316 18141 webserver.cc:460] Webserver started at http://127.29.190.131:43947/ using document root <none> and password file <none>
I20260812 00:30:43.176507 18141 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:43.176764 18141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 00:30:43 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494643, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:43.216809 18141 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 00:30:43.228147 18172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:43.230207 18141 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.006s sys 0.005s
I20260812 00:30:43.230464 18141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "b294110c9d5647428d505eb7775a4b19"
format_stamp: "Formatted at 2026-08-12 00:30:39 on dist-test-slave-c12x"
server_key: "be66bb327cbeffc7ba2d18d9434e0e4d"
server_key_iv: "63f031a663d734f14577b43e702bc665"
server_key_version: "kuduclusterkey@0"
I20260812 00:30:43.232023 18141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 12 00:30:43 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494642, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for HTTP/127.29.190.148@KRBTEST.COM
I20260812 00:30:43.278875 18141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:43.284543 18141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:43.284946 18141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:43.294042 18141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:43.316465 18141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:43.316679 18141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 00:30:43.316840 18141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:43.316953 18141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:43.530293 18141 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:38307
I20260812 00:30:43.530340 18374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:38307 every 8 connection(s)
I20260812 00:30:43.531872 18141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:30:43.540587 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 18141
Aug 12 00:30:43 dist-test-slave-c12x krb5kdc[15983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494643, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:43.560645 18383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.541957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59864 (local address 127.29.190.190:46137)
0812 00:30:43.543929 (+ 1972us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.543933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.543949 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:30:43.543990 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.543993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.544073 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.544203 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:43.546334 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.547198 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.549912 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.550524 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.550688 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.553816 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:43.553822 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:43.553825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:43.553910 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:43.557628 (+ 3718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:43.558465 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:43.558473 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:43.558476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:43.558613 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:43.558991 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:43.558997 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:43.559001 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:43.559265 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:43.559580 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.559899 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.560148 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1882,"thread_start_us":1734,"threads_started":1}
I20260812 00:30:43.561025 18381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.535718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46137 (local address 127.29.190.131:52237)
0812 00:30:43.536563 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:43.536601 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:43.538518 (+ 1917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:43.539293 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:43.539301 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:43.539818 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:43.540650 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.540680 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.542607 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.542615 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.545155 (+ 2540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.545177 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.546335 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.546345 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.546731 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.547720 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:43.547745 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:43.549976 (+ 2231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:43.555544 (+ 5568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:43.555558 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:43.555582 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:43.556276 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:43.556762 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:43.556767 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:43.556770 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:43.557071 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:43.558014 (+ 943us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:43.558023 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:43.558508 (+ 485us) client_negotiation.cc:769] Sending connection context
0812 00:30:43.558831 (+ 323us) client_negotiation.cc:240] Negotiation successful
0812 00:30:43.559530 (+ 699us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":370,"threads_started":1}
I20260812 00:30:43.562362 18379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.534995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:52237 (local address 127.29.190.190:46137)
0812 00:30:43.535628 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.535633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.536724 (+ 1091us) server_negotiation.cc:407] Connection header received
0812 00:30:43.538796 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.538802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.538914 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.539040 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:43.540902 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.542334 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.545372 (+ 3038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.546049 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.546146 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.550295 (+ 4149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:43.550307 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:43.550313 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:43.550388 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:43.555256 (+ 4868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:43.556434 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:43.556439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:43.556443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:43.556642 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:43.557212 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:43.557359 (+ 147us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:43.557363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:43.557757 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:43.557909 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.561718 (+ 3809us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.561953 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":338,"threads_started":1}
I20260812 00:30:43.563869 18375 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46137
I20260812 00:30:43.564229 18375 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:43.565003 18375 heartbeater.cc:511] Master 127.29.190.190:46137 requested a full tablet report, sending...
I20260812 00:30:43.566519 17610 ts_manager.cc:194] Registered new tserver with Master: b294110c9d5647428d505eb7775a4b19 (127.29.190.131:38307)
I20260812 00:30:43.567382 17610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:52237
I20260812 00:30:43.576102 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:30:43.595074 18135 heartbeater.cc:503] Master 127.29.190.190:46137 was elected leader, sending a full tablet report...
I20260812 00:30:43.595678 18379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.579553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59872 (local address 127.29.190.190:46137)
0812 00:30:43.579792 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.579802 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.580305 (+ 503us) server_negotiation.cc:407] Connection header received
0812 00:30:43.580478 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.580482 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.580549 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.580630 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:43.582832 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.583625 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.585691 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.586207 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.586303 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.589893 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:43.589898 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:43.589901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:43.589938 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:43.592729 (+ 2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:43.593643 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:43.593647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:43.593650 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:43.593778 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:43.594187 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:43.594190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:43.594192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:43.594451 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:43.594635 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.595070 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.595303 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:30:43.600873 17609 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:30:43.608608 17609 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:30:43.648927 18409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.624741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:38307 (local address 127.0.0.1:45060)
0812 00:30:43.637868 (+ 13127us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:43.637924 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:43.638172 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:43.640600 (+ 2428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:43.640606 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:43.640640 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:43.641096 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.641111 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.643327 (+ 2216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.643332 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.645843 (+ 2511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.645853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.647868 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.647875 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.648099 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.648175 (+ 76us) client_negotiation.cc:769] Sending connection context
0812 00:30:43.648290 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 00:30:43.648491 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12834,"mutex_wait_us":87,"thread_start_us":14513,"threads_started":1}
I20260812 00:30:43.649168 18410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.625434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52474 (local address 127.29.190.129:33033)
0812 00:30:43.637057 (+ 11623us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.637072 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.639054 (+ 1982us) server_negotiation.cc:407] Connection header received
0812 00:30:43.639316 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.639323 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.639632 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.639854 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:43.640982 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.642745 (+ 1763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.646021 (+ 3276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.647602 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.647796 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.647991 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.648595 (+ 604us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.648779 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11377,"thread_start_us":10973,"threads_started":1}
I20260812 00:30:43.650413 18411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.625170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45060 (local address 127.29.190.131:38307)
0812 00:30:43.640008 (+ 14838us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.640017 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.640049 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:30:43.640146 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.640153 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.640371 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.641335 (+ 964us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:43.641631 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.643167 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.646056 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.647602 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.649571 (+ 1969us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.649764 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.649834 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.650006 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14633,"thread_start_us":14448,"threads_started":1}
I20260812 00:30:43.650523 18408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.625168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52474)
0812 00:30:43.638837 (+ 13669us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:43.638883 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:43.639103 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:43.640154 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:43.640162 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:43.640193 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:43.640730 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.640750 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.642928 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.642933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.645830 (+ 2897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.645847 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.648208 (+ 2361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.648213 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.648382 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.648412 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 00:30:43.649980 (+ 1568us) client_negotiation.cc:240] Negotiation successful
0812 00:30:43.650119 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13468,"mutex_wait_us":141,"thread_start_us":12169,"threads_started":1}
I20260812 00:30:43.654134 18253 tablet_service.cc:1467] Processing CreateTablet for tablet 7d26f55281e447118888dfbeaeeb84f8 (DEFAULT_TABLE table=test-table [id=1d871b9cc47448aab669fa585fa4e0d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:43.655604 18253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d26f55281e447118888dfbeaeeb84f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:43.655400 17825 tablet_service.cc:1467] Processing CreateTablet for tablet 7d26f55281e447118888dfbeaeeb84f8 (DEFAULT_TABLE table=test-table [id=1d871b9cc47448aab669fa585fa4e0d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:43.657239 17825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d26f55281e447118888dfbeaeeb84f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:43.667812 18413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.640228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46408 (local address 127.29.190.130:36955)
0812 00:30:43.657324 (+ 17096us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.657335 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.657385 (+ 50us) server_negotiation.cc:407] Connection header received
0812 00:30:43.657581 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.657596 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.657938 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.658177 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:43.659287 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.661185 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.664220 (+ 3035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.666032 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.666293 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.666601 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.667121 (+ 520us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.667313 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16886,"thread_start_us":16483,"threads_started":1}
I20260812 00:30:43.669041 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.640137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:36955 (local address 127.0.0.1:46408)
0812 00:30:43.646894 (+ 6757us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:43.646925 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:43.647108 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:43.658532 (+ 11424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:43.658539 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:43.658576 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:43.659011 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.659030 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.661409 (+ 2379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.661416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.663976 (+ 2560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.663997 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.666683 (+ 2686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.666690 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.666869 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.666904 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:30:43.667066 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 00:30:43.668554 (+ 1488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6548,"thread_start_us":7164,"threads_started":1}
I20260812 00:30:43.671248 18415 tablet_bootstrap.cc:492] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Bootstrap starting.
I20260812 00:30:43.674922 18415 tablet_bootstrap.cc:654] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:43.674454 18028 tablet_service.cc:1467] Processing CreateTablet for tablet 7d26f55281e447118888dfbeaeeb84f8 (DEFAULT_TABLE table=test-table [id=1d871b9cc47448aab669fa585fa4e0d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:43.676177 18418 tablet_bootstrap.cc:492] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Bootstrap starting.
I20260812 00:30:43.676275 18415 log.cc:824] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:43.676622 18028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d26f55281e447118888dfbeaeeb84f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:43.680794 18418 tablet_bootstrap.cc:654] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:43.682363 18418 log.cc:824] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:43.686338 18418 tablet_bootstrap.cc:492] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: No bootstrap required, opened a new log
I20260812 00:30:43.686784 18418 ts_tablet_manager.cc:1397] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260812 00:30:43.690328 18415 tablet_bootstrap.cc:492] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: No bootstrap required, opened a new log
I20260812 00:30:43.690632 18415 ts_tablet_manager.cc:1397] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.004s
I20260812 00:30:43.691939 18423 tablet_bootstrap.cc:492] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Bootstrap starting.
I20260812 00:30:43.695197 18423 tablet_bootstrap.cc:654] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:43.696606 18423 log.cc:824] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:43.697626 18418 raft_consensus.cc:348] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.698097 18418 raft_consensus.cc:374] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:43.698246 18418 raft_consensus.cc:729] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b056912e81a14f6e9332351c36652fe8, State: Initialized, Role: FOLLOWER
I20260812 00:30:43.698923 18418 consensus_queue.cc:260] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.700143 18423 tablet_bootstrap.cc:492] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: No bootstrap required, opened a new log
I20260812 00:30:43.700264 17919 heartbeater.cc:503] Master 127.29.190.190:46137 was elected leader, sending a full tablet report...
I20260812 00:30:43.700635 18423 ts_tablet_manager.cc:1397] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 00:30:43.700903 18418 ts_tablet_manager.cc:1428] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Time spent starting tablet: real 0.014s user 0.007s sys 0.005s
I20260812 00:30:43.701331 18415 raft_consensus.cc:348] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.701730 18415 raft_consensus.cc:374] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:43.701853 18415 raft_consensus.cc:729] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b294110c9d5647428d505eb7775a4b19, State: Initialized, Role: FOLLOWER
I20260812 00:30:43.702463 18415 consensus_queue.cc:260] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.703994 18415 ts_tablet_manager.cc:1428] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
I20260812 00:30:43.704526 18375 heartbeater.cc:503] Master 127.29.190.190:46137 was elected leader, sending a full tablet report...
I20260812 00:30:43.710357 18423 raft_consensus.cc:348] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.710726 18423 raft_consensus.cc:374] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:43.710803 18423 raft_consensus.cc:729] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63471aff84248cdb5b5f1d1e8caf421, State: Initialized, Role: FOLLOWER
I20260812 00:30:43.711380 18423 consensus_queue.cc:260] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.713172 18423 ts_tablet_manager.cc:1428] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Time spent starting tablet: real 0.012s user 0.008s sys 0.003s
W20260812 00:30:43.773017 17920 tablet.cc:2369] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:30:43.783946 18377 tablet.cc:2369] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:30:43.805756 18137 tablet.cc:2369] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:30:43.915314 18429 raft_consensus.cc:482] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:30:43.915761 18429 raft_consensus.cc:504] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.917626 18429 leader_election.cc:288] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b294110c9d5647428d505eb7775a4b19 (127.29.190.131:38307), b056912e81a14f6e9332351c36652fe8 (127.29.190.129:33033)
I20260812 00:30:43.924494 18411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.918120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:47363 (local address 127.29.190.131:38307)
0812 00:30:43.918352 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.918361 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.919086 (+ 725us) server_negotiation.cc:407] Connection header received
0812 00:30:43.919331 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.919335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.919394 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.919538 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:43.920145 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.920852 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.922741 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.923573 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.923756 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.923831 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.924115 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.924237 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 00:30:43.924661 18430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.918096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:38307 (local address 127.29.190.130:47363)
0812 00:30:43.918945 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:43.918968 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:43.919167 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:43.919554 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:43.919559 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:43.919585 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:43.919982 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.919991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.920984 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.920991 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.922579 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.922591 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.923777 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.923784 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.923940 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.923967 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 00:30:43.924089 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 00:30:43.924217 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"mutex_wait_us":56,"thread_start_us":486,"threads_started":1}
I20260812 00:30:43.924715 18410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.918395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:39197 (local address 127.29.190.129:33033)
0812 00:30:43.918659 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.918669 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.919329 (+ 660us) server_negotiation.cc:407] Connection header received
0812 00:30:43.919563 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.919568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.919626 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.919781 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:43.920364 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.921153 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.922963 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.923798 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.923972 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.924051 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.924338 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.924468 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:30:43.924839 18431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.918201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.29.190.130:39197)
0812 00:30:43.919217 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:43.919231 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:43.919387 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:43.919803 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:43.919807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:43.919832 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:43.920205 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.920215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.921295 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.921300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.922813 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:43.922825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.924032 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.924038 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:43.924179 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.924201 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 00:30:43.924301 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 00:30:43.924424 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"mutex_wait_us":1,"thread_start_us":658,"threads_started":1}
I20260812 00:30:43.925819 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d26f55281e447118888dfbeaeeb84f8" candidate_uuid: "d63471aff84248cdb5b5f1d1e8caf421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b294110c9d5647428d505eb7775a4b19" is_pre_election: true
I20260812 00:30:43.925817 17853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d26f55281e447118888dfbeaeeb84f8" candidate_uuid: "d63471aff84248cdb5b5f1d1e8caf421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b056912e81a14f6e9332351c36652fe8" is_pre_election: true
I20260812 00:30:43.926295 18285 raft_consensus.cc:2454] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63471aff84248cdb5b5f1d1e8caf421 in term 0.
I20260812 00:30:43.926314 17853 raft_consensus.cc:2454] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d63471aff84248cdb5b5f1d1e8caf421 in term 0.
I20260812 00:30:43.926955 17966 leader_election.cc:302] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b056912e81a14f6e9332351c36652fe8, b294110c9d5647428d505eb7775a4b19, d63471aff84248cdb5b5f1d1e8caf421; no voters:
I20260812 00:30:43.927367 18429 raft_consensus.cc:2781] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:30:43.927573 18429 raft_consensus.cc:482] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:30:43.927682 18429 raft_consensus.cc:3037] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:43.929900 18429 raft_consensus.cc:504] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.930569 18429 leader_election.cc:288] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [CANDIDATE]: Term 1 election: Requested vote from peers b294110c9d5647428d505eb7775a4b19 (127.29.190.131:38307), b056912e81a14f6e9332351c36652fe8 (127.29.190.129:33033)
I20260812 00:30:43.930975 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d26f55281e447118888dfbeaeeb84f8" candidate_uuid: "d63471aff84248cdb5b5f1d1e8caf421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b294110c9d5647428d505eb7775a4b19"
I20260812 00:30:43.931028 17853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d26f55281e447118888dfbeaeeb84f8" candidate_uuid: "d63471aff84248cdb5b5f1d1e8caf421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b056912e81a14f6e9332351c36652fe8"
I20260812 00:30:43.931182 18285 raft_consensus.cc:3037] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:43.931233 17853 raft_consensus.cc:3037] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:43.933470 17853 raft_consensus.cc:2454] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63471aff84248cdb5b5f1d1e8caf421 in term 1.
I20260812 00:30:43.933516 18285 raft_consensus.cc:2454] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d63471aff84248cdb5b5f1d1e8caf421 in term 1.
I20260812 00:30:43.934000 17961 leader_election.cc:302] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b056912e81a14f6e9332351c36652fe8, b294110c9d5647428d505eb7775a4b19, d63471aff84248cdb5b5f1d1e8caf421; no voters:
I20260812 00:30:43.934382 18429 raft_consensus.cc:2781] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:30:43.934844 18429 raft_consensus.cc:686] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 1 LEADER]: Becoming Leader. State: Replica: d63471aff84248cdb5b5f1d1e8caf421, State: Running, Role: LEADER
I20260812 00:30:43.935338 18429 consensus_queue.cc:237] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } }
I20260812 00:30:43.939936 17606 catalog_manager.cc:5495] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 reported cstate change: term changed from 0 to 1, leader changed from <none> to d63471aff84248cdb5b5f1d1e8caf421 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "d63471aff84248cdb5b5f1d1e8caf421" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d63471aff84248cdb5b5f1d1e8caf421" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 } health_report { overall_health: UNKNOWN } } }
I20260812 00:30:43.966584 18413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:43.960727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46416 (local address 127.29.190.130:36955)
0812 00:30:43.960967 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:43.960972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:43.960992 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:30:43.961083 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:43.961086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:43.961171 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:43.961305 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:30:43.961696 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.962465 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.964099 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:43.964517 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:43.964617 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:43.965251 (+ 634us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:30:43.965873 (+ 622us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:30:43.966016 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:43.966197 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 00:30:43.966340 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 00:30:43.975297 18285 raft_consensus.cc:1261] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 1 FOLLOWER]: Refusing update from remote peer d63471aff84248cdb5b5f1d1e8caf421: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:30:43.975299 17853 raft_consensus.cc:1261] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 1 FOLLOWER]: Refusing update from remote peer d63471aff84248cdb5b5f1d1e8caf421: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:30:43.976547 18433 consensus_queue.cc:1035] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b294110c9d5647428d505eb7775a4b19" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 38307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:30:43.976990 18429 consensus_queue.cc:1035] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b056912e81a14f6e9332351c36652fe8" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 33033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:30:44.010496 17606 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:30:44.010857 17606 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:30:44.015353 17606 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec943c1669b5421ea661a3312392e682: Sending DeleteTablet for 3 replicas of tablet 7d26f55281e447118888dfbeaeeb84f8
I20260812 00:30:44.016866 18253 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d26f55281e447118888dfbeaeeb84f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:30:44 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:45060
I20260812 00:30:44.016970 18028 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d26f55281e447118888dfbeaeeb84f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:30:44 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:46408
I20260812 00:30:44.017133 17825 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d26f55281e447118888dfbeaeeb84f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:30:44 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:52474
I20260812 00:30:44.025238 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 17667
I20260812 00:30:44.028081 18452 tablet_replica.cc:330] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: stopping tablet replica
I20260812 00:30:44.028725 18452 raft_consensus.cc:2229] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:30:44.029452 18452 raft_consensus.cc:2258] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:30:44.030561 18449 tablet_replica.cc:330] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: stopping tablet replica
I20260812 00:30:44.031121 18449 raft_consensus.cc:2229] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:30:44.032033 18449 raft_consensus.cc:2258] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:30:44.033212 18451 tablet_replica.cc:330] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: stopping tablet replica
I20260812 00:30:44.034933 18449 ts_tablet_manager.cc:1905] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:30:44.035600 18451 raft_consensus.cc:2229] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:30:44.036222 18451 raft_consensus.cc:2258] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:30:44.036564 18452 ts_tablet_manager.cc:1905] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:30:44.042724 18449 ts_tablet_manager.cc:1918] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:30:44.042943 18449 log.cc:1196] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/7d26f55281e447118888dfbeaeeb84f8
I20260812 00:30:44.043568 18449 ts_tablet_manager.cc:1939] T 7d26f55281e447118888dfbeaeeb84f8 P d63471aff84248cdb5b5f1d1e8caf421: Deleting consensus metadata
I20260812 00:30:44.044585 18451 ts_tablet_manager.cc:1905] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:30:44.045548 17588 catalog_manager.cc:4841] TS d63471aff84248cdb5b5f1d1e8caf421 (127.29.190.130:36955): tablet 7d26f55281e447118888dfbeaeeb84f8 (table test-table [id=1d871b9cc47448aab669fa585fa4e0d0]) successfully deleted
I20260812 00:30:44.049356 18410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.027105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52488 (local address 127.29.190.129:33033)
0812 00:30:44.027292 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:44.027298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:44.027317 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:30:44.027379 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:44.027385 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:44.027513 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:44.027628 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:44.029712 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:44.030915 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:44.035023 (+ 4108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:44.035845 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:44.035978 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:44.040156 (+ 4178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:44.040170 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:44.040189 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:44.040243 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:44.044833 (+ 4590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:44.045966 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:44.045977 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:44.045981 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:44.046175 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:44.046702 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:44.046708 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:44.046712 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:44.047216 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:44.047597 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:44.048604 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0812 00:30:44.048893 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:30:44.050705 17912 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:44.054962 18451 ts_tablet_manager.cc:1918] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:30:44.055284 18451 log.cc:1196] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/7d26f55281e447118888dfbeaeeb84f8
I20260812 00:30:44.055956 18451 ts_tablet_manager.cc:1939] T 7d26f55281e447118888dfbeaeeb84f8 P b294110c9d5647428d505eb7775a4b19: Deleting consensus metadata
I20260812 00:30:44.058135 17588 catalog_manager.cc:4841] TS b294110c9d5647428d505eb7775a4b19 (127.29.190.131:38307): tablet 7d26f55281e447118888dfbeaeeb84f8 (table test-table [id=1d871b9cc47448aab669fa585fa4e0d0]) successfully deleted
I20260812 00:30:44.146615 18452 ts_tablet_manager.cc:1918] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:30:44.146950 18452 log.cc:1196] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/7d26f55281e447118888dfbeaeeb84f8
I20260812 00:30:44.147753 18452 ts_tablet_manager.cc:1939] T 7d26f55281e447118888dfbeaeeb84f8 P b056912e81a14f6e9332351c36652fe8: Deleting consensus metadata
I20260812 00:30:44.147744 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 17667
I20260812 00:30:44.175490 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 17925
W20260812 00:30:44.175396 17587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.190.129:33033 (error 108)
I20260812 00:30:44.178047 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.176952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52494)
0812 00:30:44.177661 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:44.177816 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":451,"threads_started":1}
W20260812 00:30:44.178397 17587 catalog_manager.cc:4584] TS b056912e81a14f6e9332351c36652fe8 (127.29.190.129:33033): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d26f55281e447118888dfbeaeeb84f8: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
I20260812 00:30:44.191526 18413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.176580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46420 (local address 127.29.190.130:36955)
0812 00:30:44.176853 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:44.176858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:44.176876 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:30:44.176940 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:44.176946 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:44.177011 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:44.177178 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:44.178948 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:44.179877 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:44.181163 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:44.181737 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:44.181901 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:44.184645 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:44.184661 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:44.184677 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:44.184720 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:44.188425 (+ 3705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:44.189191 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:44.189200 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:44.189202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:44.189355 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:44.189737 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:44.189743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:44.189746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:44.190145 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:44.190531 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:44.190824 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:30:44.191082 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:30:44.192252 18127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:44.232272 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.231726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52504)
0812 00:30:44.232009 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:44.232128 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260812 00:30:44.233502 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.233046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52508)
0812 00:30:44.233242 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:44.233319 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 00:30:44.294268 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.293785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52516)
0812 00:30:44.294011 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:44.294117 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 00:30:44.295575 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.295120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52522)
0812 00:30:44.295278 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:44.295361 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 00:30:44.307865 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 17925
I20260812 00:30:44.337354 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 18141
I20260812 00:30:44.350816 18411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.338165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45072 (local address 127.29.190.131:38307)
0812 00:30:44.338360 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:44.338365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:44.338383 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:30:44.338552 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:44.338556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:44.338624 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:44.338711 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:44.340231 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:44.340935 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:44.342345 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:44.342742 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:44.342835 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:44.345419 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:44.345432 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:44.345449 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:44.345488 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:44.348443 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:44.349132 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:44.349139 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:44.349142 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:44.349265 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:44.349580 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:44.349583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:44.349585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:44.349922 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:44.350151 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:44.350387 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 00:30:44.350553 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:30:44.351503 18366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:44.376497 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.375984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52538)
0812 00:30:44.376206 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:44.376303 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260812 00:30:44.377640 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.377219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52548)
0812 00:30:44.377428 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:44.377505 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 00:30:44.444643 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 18141
I20260812 00:30:44.468896 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 17562
I20260812 00:30:44.470193 17656 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:44.584597 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:44.583677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:33033 (local address 127.0.0.1:52552)
0812 00:30:44.584313 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:44.584437 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:33033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434}
I20260812 00:30:44.584961 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 17562
I20260812 00:30:44.624025 30458 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 00:30:44.970273 30458 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 00:30:44.970556 30458 mini_ranger.cc:66] Stopping Ranger...
I20260812 00:30:45.318214 30458 mini_ranger.cc:68] Stopped Ranger
2026-08-12 00:30:45.318 UTC [16026] LOG: received smart shutdown request
2026-08-12 00:30:45.321 UTC [16026] LOG: background worker "logical replication launcher" (PID 16045) exited with exit code 1
2026-08-12 00:30:45.321 UTC [16031] LOG: shutting down
2026-08-12 00:30:45.486 UTC [16026] LOG: database system is shut down
2026-08-12T00:30:45Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (55401 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:30:45 dist-test-slave-c12x krb5kdc[18475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:30:45 dist-test-slave-c12x krb5kdc[18475](info): set up 2 sockets
Aug 12 00:30:45 dist-test-slave-c12x krb5kdc[18475](info): commencing operation
krb5kdc: starting...
W20260812 00:30:47.050640 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.355s user 0.011s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:30:47 dist-test-slave-c12x krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:30:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:30:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:30:47.338521 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:43175
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:43175,127.29.190.189:45977,127.29.190.188:39751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:47.694978 18499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:47.695370 18499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:47.695554 18499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:47.703598 18499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:30:47.703765 18499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:47.703876 18499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:47.703981 18499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:30:47.704075 18499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:30:47.714828 18499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:43175,127.29.190.189:45977,127.29.190.188:39751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:43175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:47.716418 18499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:47.717787 18499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:47.730299 18507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:47.730239 18509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:47.730688 18512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:47.731573 18499 server_base.cc:1034] running on GCE node
I20260812 00:30:47.732400 18499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:47.733943 18499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:47.735191 18499 hybrid_clock.cc:648] HybridClock initialized: now 1786494647735128 us; error 59 us; skew 500 ppm
I20260812 00:30:47.735627 18499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:47 dist-test-slave-c12x krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494647, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:47.743520 18499 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:30:47.745268 18499 webserver.cc:460] Webserver started at http://127.29.190.190:44773/ using document root <none> and password file <none>
I20260812 00:30:47.746040 18499 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:47.746192 18499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:47.746527 18499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:30:47.749891 18499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "21cdd06d92914563b076611f486ad88f"
format_stamp: "Formatted at 2026-08-12 00:30:47 on dist-test-slave-c12x"
server_key: "2e91b08f69f39f27f69d65e5fa77dc78"
server_key_iv: "690e560dab7b2b662d75ffa909bf5b94"
server_key_version: "encryptionkey@0"
I20260812 00:30:47.750810 18499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "21cdd06d92914563b076611f486ad88f"
format_stamp: "Formatted at 2026-08-12 00:30:47 on dist-test-slave-c12x"
server_key: "2e91b08f69f39f27f69d65e5fa77dc78"
server_key_iv: "690e560dab7b2b662d75ffa909bf5b94"
server_key_version: "encryptionkey@0"
I20260812 00:30:47.756724 18499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260812 00:30:47.760679 18524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:47.762095 18499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:30:47.762296 18499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "21cdd06d92914563b076611f486ad88f"
format_stamp: "Formatted at 2026-08-12 00:30:47 on dist-test-slave-c12x"
server_key: "2e91b08f69f39f27f69d65e5fa77dc78"
server_key_iv: "690e560dab7b2b662d75ffa909bf5b94"
server_key_version: "encryptionkey@0"
I20260812 00:30:47.762540 18499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:47.785149 18499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:47.790411 18499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:47.790844 18499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:47.812824 18499 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:43175
I20260812 00:30:47.812898 18599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:43175 every 8 connection(s)
I20260812 00:30:47.814958 18499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:30:47.816825 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 18499
I20260812 00:30:47.817087 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:30:47.818017 30458 external_mini_cluster.cc:1428] Setting key 04bb9aa543d9b50ddcb74fcfd05df652
I20260812 00:30:47.820129 18600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:47.830442 18600 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:30:47 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494647, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.190.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.189@KRBTEST.COM" created.
I20260812 00:30:47.861052 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:47.834739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:43175 (local address 127.0.0.1:41038)
0812 00:30:47.835697 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:47.835745 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:47.839250 (+ 3505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:47.841924 (+ 2674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:47.841930 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:47.842583 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:47.842962 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:47.842981 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:47.844681 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:47.844688 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:47.845820 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:47.845833 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:47.846841 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:47.846848 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:47.847586 (+ 738us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:47.848407 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:47.848436 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:47.851690 (+ 3254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:47.855786 (+ 4096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:47.855800 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:47.855816 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:47.856525 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:47.856981 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:47.856988 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:47.856992 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:47.857221 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:47.858359 (+ 1138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:47.858368 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:47.858613 (+ 245us) client_negotiation.cc:769] Sending connection context
0812 00:30:47.858884 (+ 271us) client_negotiation.cc:240] Negotiation successful
0812 00:30:47.859649 (+ 765us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":229,"thread_start_us":377,"threads_started":1}
I20260812 00:30:47.861086 18608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:47.836162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41038 (local address 127.29.190.190:43175)
0812 00:30:47.840952 (+ 4790us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:47.840964 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:47.841010 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:30:47.841215 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:47.841226 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:47.841602 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:47.841889 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:47.843195 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:47.844516 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:47.845978 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:47.846584 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:47.846798 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:47.851963 (+ 5165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:47.851971 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:47.851986 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:47.852026 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:47.855634 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:47.856682 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:47.856692 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:47.856695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:47.856862 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:47.857351 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:47.857355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:47.857357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:47.858202 (+ 845us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:47.858437 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:47.859007 (+ 570us) server_negotiation.cc:299] Negotiation successful
0812 00:30:47.859510 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":4551,"thread_start_us":4388,"threads_started":1}
I20260812 00:30:47.864609 18600 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:30:47.865721 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:47.865290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57212)
0812 00:30:47.865469 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:47.865599 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 00:30:47.866071 18529 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
I20260812 00:30:47.867956 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:47.867524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57216)
0812 00:30:47.867670 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:47.867762 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 00:30:47.868228 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:45977: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab.
Entry for principal kudu/127.29.190.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab.
I20260812 00:30:47.901324 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.189:45977
--webserver_interface=127.29.190.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab
--principal=kudu/127.29.190.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:43175,127.29.190.189:45977,127.29.190.188:39751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:30:47.917725 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } attempt: 1
I20260812 00:30:47.919284 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:47.918625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57228)
0812 00:30:47.918902 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:47.919093 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 00:30:47.920643 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:47.920132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57230)
0812 00:30:47.920341 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:47.920445 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 00:30:47.920934 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:45977: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
I20260812 00:30:47.989243 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } attempt: 2
I20260812 00:30:47.990634 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:47.990036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57234)
0812 00:30:47.990329 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:47.990447 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 00:30:47.991771 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:47.991337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57248)
0812 00:30:47.991534 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:47.991618 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 00:30:47.992075 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:45977: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
I20260812 00:30:48.083420 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } attempt: 3
I20260812 00:30:48.084837 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.084251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57262)
0812 00:30:48.084517 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.084663 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260812 00:30:48.086163 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.085640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57268)
0812 00:30:48.085847 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.085974 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 00:30:48.086423 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:45977: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
I20260812 00:30:48.229812 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } attempt: 4
I20260812 00:30:48.231258 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.230630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57282)
0812 00:30:48.230999 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.231113 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
I20260812 00:30:48.232548 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.232122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57294)
0812 00:30:48.232309 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.232409 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260812 00:30:48.232826 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:45977: Network error: Client connection negotiation failed: client connection to 127.29.190.189:45977: connect: Connection refused (error 111)
W20260812 00:30:48.261822 18611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:48.262117 18611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:48.262317 18611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:48.269896 18611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:30:48.270002 18611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:48.270107 18611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:48.270215 18611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:30:48.270298 18611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:30:48.280732 18611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:43175,127.29.190.189:45977,127.29.190.188:39751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab
--principal=kudu/127.29.190.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.189:45977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.190.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:48.282673 18611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:48.284155 18611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:48.296633 18619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:48.296672 18620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:48.296718 18625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:48.297518 18611 server_base.cc:1034] running on GCE node
I20260812 00:30:48.298348 18611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:48.299957 18611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:48.301173 18611 hybrid_clock.cc:648] HybridClock initialized: now 1786494648301133 us; error 42 us; skew 500 ppm
I20260812 00:30:48.301549 18611 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494648, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:48.304996 18611 init.cc:377] Logged in from keytab as kudu/127.29.190.189@KRBTEST.COM (short username kudu)
I20260812 00:30:48.306510 18611 webserver.cc:460] Webserver started at http://127.29.190.189:41429/ using document root <none> and password file <none>
I20260812 00:30:48.307214 18611 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:48.307318 18611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:48.307674 18611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:30:48.310986 18611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/data/instance:
uuid: "8ca8b6e0c6734df08b9a295f26a3c790"
format_stamp: "Formatted at 2026-08-12 00:30:48 on dist-test-slave-c12x"
server_key: "ef7e3519eb8d4d1d12fde7603b026917"
server_key_iv: "68ae497c4884765981e54259153594d8"
server_key_version: "encryptionkey@0"
I20260812 00:30:48.311889 18611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/wal/instance:
uuid: "8ca8b6e0c6734df08b9a295f26a3c790"
format_stamp: "Formatted at 2026-08-12 00:30:48 on dist-test-slave-c12x"
server_key: "ef7e3519eb8d4d1d12fde7603b026917"
server_key_iv: "68ae497c4884765981e54259153594d8"
server_key_version: "encryptionkey@0"
I20260812 00:30:48.317400 18611 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:30:48.321087 18637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:48.322499 18611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260812 00:30:48.322639 18611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/wal
uuid: "8ca8b6e0c6734df08b9a295f26a3c790"
format_stamp: "Formatted at 2026-08-12 00:30:48 on dist-test-slave-c12x"
server_key: "ef7e3519eb8d4d1d12fde7603b026917"
server_key_iv: "68ae497c4884765981e54259153594d8"
server_key_version: "encryptionkey@0"
I20260812 00:30:48.322813 18611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:48.345093 18611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:48.349650 18611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:48.349901 18611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:48.369498 18611 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.189:45977
I20260812 00:30:48.369623 18725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.189:45977 every 8 connection(s)
I20260812 00:30:48.370911 18611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
I20260812 00:30:48.372097 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 18611
I20260812 00:30:48.372339 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-1/wal/instance
I20260812 00:30:48.373004 30458 external_mini_cluster.cc:1428] Setting key c5541f33c1a7673738d7cd4a1128433d
I20260812 00:30:48.376157 18727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:48.386551 18727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.29.190.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.188@KRBTEST.COM" created.
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494648, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:48.411247 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.389649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41042 (local address 127.29.190.190:43175)
0812 00:30:48.390243 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.390248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.391371 (+ 1123us) server_negotiation.cc:407] Connection header received
0812 00:30:48.393502 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.393509 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.393607 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.393742 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.395471 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.396418 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.398045 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.398477 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.398615 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.403696 (+ 5081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.403705 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.403713 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.403779 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.407638 (+ 3859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.408416 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.408424 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.408431 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.408607 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.409019 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.409026 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.409032 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.409477 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.409639 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.410446 (+ 807us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.410746 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":338,"threads_started":1}
I20260812 00:30:48.411839 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.390282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:43175 (local address 127.0.0.1:41042)
0812 00:30:48.391158 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.391210 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:48.393161 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:48.394021 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:48.394030 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:48.394616 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:48.395233 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.395253 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.396613 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.396618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.397881 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.397894 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.398725 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.398733 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.398969 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.399755 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:48.399778 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:48.403382 (+ 3604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:48.407796 (+ 4414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.407804 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.407818 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.408284 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.408727 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.408730 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.408732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.408899 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.409602 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:48.409608 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:48.409949 (+ 341us) client_negotiation.cc:769] Sending connection context
0812 00:30:48.410189 (+ 240us) client_negotiation.cc:240] Negotiation successful
0812 00:30:48.410681 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":373,"threads_started":1}
I20260812 00:30:48.413898 18727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494648, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:30:48.431895 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.414618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57310)
0812 00:30:48.414886 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.414906 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:48.415011 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:48.416016 (+ 1005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:48.416024 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:48.416547 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:48.416790 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.416806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.418259 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.418267 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.419930 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.419949 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.420796 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.420808 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.421072 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.421711 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:48.421739 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:48.424402 (+ 2663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:48.429229 (+ 4827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.429233 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.429236 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.429641 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.430104 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.430107 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.430109 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.430247 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.431027 (+ 780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:48.431031 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:48.431142 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 00:30:48.431252 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 00:30:48.431598 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139}
I20260812 00:30:48.432031 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.414837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57310 (local address 127.29.190.189:45977)
0812 00:30:48.415607 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.415614 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.415640 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:30:48.415683 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.415689 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.415855 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.415978 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.416977 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.418106 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.420075 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.420623 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.420721 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.424652 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.424673 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.424697 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.424746 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.429048 (+ 4302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.429787 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.429800 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.429806 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.429964 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.430360 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.430365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.430369 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.430897 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.431099 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.431402 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.431710 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":430,"threads_started":1}
I20260812 00:30:48.434684 18727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:30:48.436153 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.435606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41438)
0812 00:30:48.435776 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.435917 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 00:30:48.436407 18643 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab.
Entry for principal kudu/127.29.190.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab.
I20260812 00:30:48.438227 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.437803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41440)
0812 00:30:48.438007 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.438119 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 00:30:48.438526 18727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
I20260812 00:30:48.439090 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.188:39751
--webserver_interface=127.29.190.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab
--principal=kudu/127.29.190.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:34491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:43175,127.29.190.189:45977,127.29.190.188:39751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:30:48.487905 18727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 1
I20260812 00:30:48.489251 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.488661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41456)
0812 00:30:48.488899 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.489035 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 00:30:48.490520 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.489921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41468)
0812 00:30:48.490190 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.490309 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260812 00:30:48.490727 18727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
I20260812 00:30:48.532126 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } attempt: 5
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494647, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:30:48.546159 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.532932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57324)
0812 00:30:48.533139 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.533167 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:48.533317 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:48.533702 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:48.533706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:48.534120 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:48.534309 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.534318 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.535342 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.535353 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.536288 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.536302 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.537106 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.537112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.537318 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.538042 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:48.538061 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:48.540257 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:48.543594 (+ 3337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.543600 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.543604 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.544013 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.544424 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.544431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.544435 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.544585 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.545128 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:48.545132 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:48.545284 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 00:30:48.545449 (+ 165us) client_negotiation.cc:240] Negotiation successful
0812 00:30:48.545785 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 00:30:48.546137 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.533158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57324 (local address 127.29.190.189:45977)
0812 00:30:48.533363 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.533372 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.533394 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:30:48.533469 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.533473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.533550 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.533662 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.534481 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.535185 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.536449 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.536925 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.537077 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.540475 (+ 3398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.540480 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.540484 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.540521 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.543314 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.544151 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.544158 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.544162 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.544299 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.544704 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.544710 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.544714 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.545004 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.545163 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.545552 (+ 389us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.545785 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:30:48.547539 18600 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:30:48.548707 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.548261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41472)
0812 00:30:48.548459 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.548560 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 00:30:48.549733 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.549360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41482)
0812 00:30:48.549548 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.549625 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 00:30:48.549934 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
I20260812 00:30:48.558965 18727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 2
I20260812 00:30:48.560084 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.559600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41498)
0812 00:30:48.559797 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.559910 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 00:30:48.561182 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.560791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41508)
0812 00:30:48.560948 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.561033 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 00:30:48.561398 18727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
I20260812 00:30:48.601209 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 1
I20260812 00:30:48.602515 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.602010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41520)
0812 00:30:48.602220 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.602335 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 00:30:48.603677 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.603308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41530)
0812 00:30:48.603512 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.603578 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 00:30:48.603890 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
I20260812 00:30:48.652642 18727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 3
I20260812 00:30:48.654018 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.653434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41534)
0812 00:30:48.653681 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.653796 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 00:30:48.655373 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.654834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41538)
0812 00:30:48.655111 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.655213 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260812 00:30:48.655661 18727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
I20260812 00:30:48.672111 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 2
I20260812 00:30:48.673460 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.672865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41540)
0812 00:30:48.673165 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.673274 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 00:30:48.674712 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.674297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41554)
0812 00:30:48.674520 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.674596 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260812 00:30:48.674957 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
I20260812 00:30:48.781226 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 3
I20260812 00:30:48.782531 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.781989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41570)
0812 00:30:48.782209 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.782307 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 00:30:48.783797 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.783274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41578)
0812 00:30:48.783549 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.783658 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260812 00:30:48.784066 18600 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
I20260812 00:30:48.798911 18727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 4
W20260812 00:30:48.799639 18739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:48.800062 18739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:48.800232 18739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 00:30:48.800383 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.799766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41584)
0812 00:30:48.800047 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.800168 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 00:30:48.801467 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.801098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41588)
0812 00:30:48.801247 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.801337 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 00:30:48.801729 18727 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:39751: Network error: Client connection negotiation failed: client connection to 127.29.190.188:39751: connect: Connection refused (error 111)
W20260812 00:30:48.808705 18739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:30:48.808840 18739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:48.808925 18739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:48.809002 18739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:30:48.809095 18739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:30:48.820230 18739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:34491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:43175,127.29.190.189:45977,127.29.190.188:39751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab
--principal=kudu/127.29.190.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.188:39751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.190.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:48.821696 18739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:48.823107 18739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:48.836803 18764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:48.836889 18761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:48.836907 18760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:48.841600 18739 server_base.cc:1034] running on GCE node
I20260812 00:30:48.842674 18739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:48.844534 18739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:48.845804 18739 hybrid_clock.cc:648] HybridClock initialized: now 1786494648845746 us; error 54 us; skew 500 ppm
I20260812 00:30:48.846231 18739 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494648, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:48.850059 18739 init.cc:377] Logged in from keytab as kudu/127.29.190.188@KRBTEST.COM (short username kudu)
I20260812 00:30:48.852303 18739 webserver.cc:460] Webserver started at http://127.29.190.188:45911/ using document root <none> and password file <none>
I20260812 00:30:48.853188 18739 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:48.853361 18739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:48.853727 18739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:30:48.857385 18739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/data/instance:
uuid: "df26db5e364c40918d11023145db5c2b"
format_stamp: "Formatted at 2026-08-12 00:30:48 on dist-test-slave-c12x"
server_key: "b1ba5e9d1f2a3ae93cac6652959e42fa"
server_key_iv: "75a3249049d5e00b7c91bfcfe0e17375"
server_key_version: "encryptionkey@0"
I20260812 00:30:48.858351 18739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/wal/instance:
uuid: "df26db5e364c40918d11023145db5c2b"
format_stamp: "Formatted at 2026-08-12 00:30:48 on dist-test-slave-c12x"
server_key: "b1ba5e9d1f2a3ae93cac6652959e42fa"
server_key_iv: "75a3249049d5e00b7c91bfcfe0e17375"
server_key_version: "encryptionkey@0"
I20260812 00:30:48.864485 18739 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:30:48.868779 18775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:48.870365 18739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260812 00:30:48.870595 18739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/wal
uuid: "df26db5e364c40918d11023145db5c2b"
format_stamp: "Formatted at 2026-08-12 00:30:48 on dist-test-slave-c12x"
server_key: "b1ba5e9d1f2a3ae93cac6652959e42fa"
server_key_iv: "75a3249049d5e00b7c91bfcfe0e17375"
server_key_version: "encryptionkey@0"
I20260812 00:30:48.870828 18739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:48.892146 18739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:48.897167 18739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:48.897490 18739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:48.919597 18739 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.188:39751
I20260812 00:30:48.919624 18862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.188:39751 every 8 connection(s)
I20260812 00:30:48.921072 18739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
I20260812 00:30:48.925034 18864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:48.927364 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 18739
I20260812 00:30:48.927589 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786494426716583-30458-0/minicluster-data/master-2/wal/instance
I20260812 00:30:48.928217 30458 external_mini_cluster.cc:1428] Setting key 9b9074b7350010c316864c78bfb468d0
I20260812 00:30:48.933733 18864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494648, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:48.953514 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.936938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41048 (local address 127.29.190.190:43175)
0812 00:30:48.937512 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.937519 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.938119 (+ 600us) server_negotiation.cc:407] Connection header received
0812 00:30:48.938309 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.938313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.938391 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.938515 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.939768 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.940502 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.942135 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.942840 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.943008 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.946914 (+ 3906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.946920 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.946923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.946967 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.950170 (+ 3203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.951015 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.951021 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.951025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.951169 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.951664 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.951669 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.951673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.952057 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.952411 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.952863 (+ 452us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.953106 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":255,"threads_started":1}
I20260812 00:30:48.953889 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.930396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41590 (local address 127.29.190.188:39751)
0812 00:30:48.931420 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.931485 (+ 65us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.931549 (+ 64us) server_negotiation.cc:407] Connection header received
0812 00:30:48.933435 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.933461 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.933888 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.934270 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.936248 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.938377 (+ 2129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.939901 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.940657 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.940887 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.945768 (+ 4881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.945779 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.945796 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.945844 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.949195 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.950105 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.950112 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.950119 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.950289 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.950708 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.950711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.950713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.951277 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.951591 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.952111 (+ 520us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.952610 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":788,"thread_start_us":495,"threads_started":1}
I20260812 00:30:48.953930 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.936998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:43175 (local address 127.0.0.1:41048)
0812 00:30:48.937955 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.938001 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:48.938173 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:48.938599 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:48.938604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:48.939235 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:48.939606 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.939618 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.940681 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.940687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.941966 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.941979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.943090 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.943096 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.943231 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.943955 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:48.943979 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:48.946704 (+ 2725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:48.950305 (+ 3601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.950318 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.950326 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.950893 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.951292 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.951297 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.951301 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.951523 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.952234 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:48.952244 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:48.952512 (+ 268us) client_negotiation.cc:769] Sending connection context
0812 00:30:48.952695 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 00:30:48.952925 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"mutex_wait_us":48,"thread_start_us":488,"threads_started":1}
I20260812 00:30:48.955634 18864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:30:48.961318 18600 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 4
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494648, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494647, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
I20260812 00:30:48.971983 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.956502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57332 (local address 127.29.190.189:45977)
0812 00:30:48.956707 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.956714 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.956885 (+ 171us) server_negotiation.cc:407] Connection header received
0812 00:30:48.957049 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.957056 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.957151 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.957263 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.958012 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.958950 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.960217 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.960632 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.960764 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.964860 (+ 4096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.964867 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.964872 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.964918 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.968593 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.969529 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.969535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.969539 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.969719 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.970215 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.970221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.970224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.970497 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.970771 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.971230 (+ 459us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.971560 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:30:48.972826 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.956307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:45977 (local address 127.0.0.1:57332)
0812 00:30:48.956783 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.956803 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:48.956919 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:48.957325 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:48.957329 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:48.957724 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:48.957876 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.957884 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.959092 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.959098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.960071 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.960084 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.960786 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.960792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.961025 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.961690 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:48.961715 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:48.964644 (+ 2929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:48.968774 (+ 4130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.968780 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.968785 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.969365 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.969893 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.969899 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.969903 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.970109 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.970723 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:48.970728 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:48.970914 (+ 186us) client_negotiation.cc:769] Sending connection context
0812 00:30:48.972270 (+ 1356us) client_negotiation.cc:240] Negotiation successful
0812 00:30:48.972552 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260812 00:30:48.974380 18864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:30:48.975632 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.957420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41058 (local address 127.29.190.190:43175)
0812 00:30:48.957601 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.957605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.958195 (+ 590us) server_negotiation.cc:407] Connection header received
0812 00:30:48.958325 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.958331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.958466 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.958572 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.959830 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.960493 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.962369 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.962941 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.963088 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.968481 (+ 5393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.968496 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.968499 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.968533 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.972066 (+ 3533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.973064 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.973068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.973072 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.973234 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.973716 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.973721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.973725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.974153 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.974519 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.974832 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.975104 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 00:30:48.979579 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.961952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41600)
0812 00:30:48.962154 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.962174 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:48.962280 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:48.962662 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:48.962667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:48.963194 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:48.963357 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.963365 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.964574 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.964580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.966375 (+ 1795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.966391 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.967466 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.967473 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.967694 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.968313 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:48.968341 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:48.971716 (+ 3375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:48.976548 (+ 4832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.976555 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.976561 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.977060 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.977508 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.977513 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.977516 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.977726 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.978489 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:48.978496 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:48.978677 (+ 181us) client_negotiation.cc:769] Sending connection context
0812 00:30:48.978861 (+ 184us) client_negotiation.cc:240] Negotiation successful
0812 00:30:48.979162 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 00:30:48.979590 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.962153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41600 (local address 127.29.190.188:39751)
0812 00:30:48.962357 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.962363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.962382 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:30:48.962436 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.962441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.962514 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.962609 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.963562 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.964423 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.966556 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.967271 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.967394 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.971942 (+ 4548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.971949 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.971954 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.971996 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.976395 (+ 4399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.977162 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.977168 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.977170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.977345 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.977852 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.977857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.977860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.978244 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.978421 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.978969 (+ 548us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.979209 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494648, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
I20260812 00:30:48.986624 18600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: Bootstrap starting.
Aug 12 00:30:48 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:30:48.991307 18600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:48.991369 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.975502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41604 (local address 127.29.190.188:39751)
0812 00:30:48.976997 (+ 1495us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.977003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.977027 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:30:48.977109 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.977116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.977191 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.977315 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.978176 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.979658 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.981284 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.981902 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.982027 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.985122 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.985127 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.985131 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.985158 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.987993 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.988839 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.988847 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.988853 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.989021 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.989552 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.989560 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.989566 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.989992 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.990156 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.990590 (+ 434us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.990869 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":1348,"thread_start_us":1152,"threads_started":1}
I20260812 00:30:48.991691 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.975193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41604)
0812 00:30:48.976861 (+ 1668us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:48.976879 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:48.976996 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:48.977336 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:48.977341 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:48.977755 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:48.977991 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.978003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.979816 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.979821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.981136 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:48.981152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.982031 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.982036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:48.982252 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.982851 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:48.982869 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:48.984912 (+ 2043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:48.988126 (+ 3214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.988133 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.988137 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.988688 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.989240 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:48.989246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:48.989249 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:48.989419 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:48.990161 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:48.990167 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:48.990337 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 00:30:48.990487 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 00:30:48.991010 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1552,"mutex_wait_us":169}
I20260812 00:30:48.997160 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:48.977759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57340 (local address 127.29.190.189:45977)
0812 00:30:48.977933 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:48.977937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:48.978167 (+ 230us) server_negotiation.cc:407] Connection header received
0812 00:30:48.978352 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:48.978357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:48.978445 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:48.978541 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:48.980734 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.981817 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.983700 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:48.984382 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:48.984492 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:48.990333 (+ 5841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:48.990340 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:48.990344 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:48.990389 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:48.994217 (+ 3828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.995078 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.995087 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.995094 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.995270 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:48.995693 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:48.995698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:48.995702 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:48.996062 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:48.996353 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:48.996551 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 00:30:48.996807 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:30:48.997627 18864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b: Bootstrap starting.
I20260812 00:30:48.998020 18600 log.cc:824] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:49.000988 18600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: No bootstrap required, opened a new log
I20260812 00:30:49.001999 18864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:49.002759 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:30:49.003293 18864 log.cc:824] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:49.006788 18864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b: No bootstrap required, opened a new log
I20260812 00:30:49.010926 18600 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.011422 18600 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:49.011574 18600 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21cdd06d92914563b076611f486ad88f, State: Initialized, Role: FOLLOWER
I20260812 00:30:49.012485 18600 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.019717 18882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.020243 18882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:30:49.021019 18864 raft_consensus.cc:348] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.021525 18864 raft_consensus.cc:374] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:49.021677 18864 raft_consensus.cc:729] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df26db5e364c40918d11023145db5c2b, State: Initialized, Role: FOLLOWER
I20260812 00:30:49.022548 18600 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:30:49.030731 18864 consensus_queue.cc:260] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.037961 18891 sys_catalog.cc:455] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.038450 18891 sys_catalog.cc:458] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:30:49.040668 18864 sys_catalog.cc:564] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:30:49.043427 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:49.009113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41614 (local address 127.29.190.188:39751)
0812 00:30:49.009326 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:49.009337 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:49.019272 (+ 9935us) server_negotiation.cc:407] Connection header received
0812 00:30:49.019864 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:49.019871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:49.019963 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:49.020035 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:49.022742 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.023881 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.026311 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.026971 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.027088 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:49.031615 (+ 4527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:49.031626 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:49.031634 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:49.031691 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:49.037219 (+ 5528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:49.040507 (+ 3288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:49.040512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:49.040515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:49.040685 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:49.041206 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:49.041213 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:49.041217 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:49.041635 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:49.041901 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:49.042669 (+ 768us) server_negotiation.cc:299] Negotiation successful
0812 00:30:49.042993 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 00:30:49.044063 18533 tablet.cc:2369] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:30:49.054123 18735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:49.023045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57352 (local address 127.29.190.189:45977)
0812 00:30:49.023262 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:49.023268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:49.030894 (+ 7626us) server_negotiation.cc:407] Connection header received
0812 00:30:49.031815 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:49.031821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:49.031912 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:49.031984 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:49.034178 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.035611 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.038266 (+ 2655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.039109 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.039240 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:49.043570 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:49.043581 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:49.043588 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:49.043638 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:49.049873 (+ 6235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:49.050839 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:49.050845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:49.050848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:49.051020 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:49.051663 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:49.051670 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:49.051676 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:49.052190 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:49.052476 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:49.053258 (+ 782us) server_negotiation.cc:299] Negotiation successful
0812 00:30:49.053603 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:30:49.056093 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:49.008762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41066 (local address 127.29.190.190:43175)
0812 00:30:49.009513 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:49.009519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:49.022670 (+ 13151us) server_negotiation.cc:407] Connection header received
0812 00:30:49.022937 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:49.022943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:49.023042 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:49.023120 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:49.025773 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.026973 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.030764 (+ 3791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.031595 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.031705 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:49.046364 (+ 14659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:49.046376 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:49.046383 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:49.046442 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:49.051578 (+ 5136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:49.052804 (+ 1226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:49.052813 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:49.052819 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:49.053019 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:49.053601 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:49.053610 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:49.053616 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:49.054084 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:49.054415 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:49.055171 (+ 756us) server_negotiation.cc:299] Negotiation successful
0812 00:30:49.055547 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604}
W20260812 00:30:49.078058 18923 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:30:49.078197 18923 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 00:30:49.080971 18922 catalog_manager.cc:1558] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:30:49.081112 18922 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:30:49.071534 18739 master_runner.cc:186] Error getting master registration for 127.29.190.189:45977: OK, instance_id { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" instance_seqno: 1786494648363873 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:30:49.084532 18739 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:30:49.071033 18499 master_runner.cc:186] Error getting master registration for 127.29.190.189:45977: OK, instance_id { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" instance_seqno: 1786494648363873 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:30:49.086113 18499 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:30:49.101001 18727 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } attempt: 5
Aug 12 00:30:49 dist-test-slave-c12x krb5kdc[18475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494648, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
I20260812 00:30:49.117703 18732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:49.101769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:39751 (local address 127.0.0.1:41620)
0812 00:30:49.102173 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:49.102198 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:49.102331 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:49.103008 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:49.103013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:49.103648 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:49.103874 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:49.103888 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.105170 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.105179 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:49.106302 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:49.106315 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.107083 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.107089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:49.107326 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:49.108045 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:49.108064 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:49.110266 (+ 2202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:49.114563 (+ 4297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:49.114569 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:49.114573 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:49.115123 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:49.115648 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:49.115653 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:49.115657 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:49.115878 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:49.116606 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:49.116611 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:49.116783 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:30:49.116950 (+ 167us) client_negotiation.cc:240] Negotiation successful
0812 00:30:49.117288 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255}
I20260812 00:30:49.117707 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:49.102329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41620 (local address 127.29.190.188:39751)
0812 00:30:49.102531 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:49.102537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:49.102555 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:30:49.102611 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:49.102616 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:49.102696 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:49.102813 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:49.104064 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.105013 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.106448 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:49.106920 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:49.107067 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:49.110479 (+ 3412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:49.110484 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:49.110488 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:49.110538 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:49.114378 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:49.115276 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:49.115282 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:49.115285 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:49.115498 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:49.116019 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:49.116025 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:49.116028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:49.116450 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:49.116678 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:49.117066 (+ 388us) server_negotiation.cc:299] Negotiation successful
0812 00:30:49.117288 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:30:49.123129 18727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: Bootstrap starting.
I20260812 00:30:49.126788 18727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:49.130728 18727 log.cc:824] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:49.133742 18727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: No bootstrap required, opened a new log
I20260812 00:30:49.141266 18727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.141714 18727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:49.141832 18727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca8b6e0c6734df08b9a295f26a3c790, State: Initialized, Role: FOLLOWER
I20260812 00:30:49.142566 18727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.147789 18929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.148285 18929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:30:49.149137 18727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 00:30:49.149785 18783 tablet.cc:2369] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:30:49.168548 18611 master_runner.cc:263] No leader master found from master 8ca8b6e0c6734df08b9a295f26a3c790
I20260812 00:30:49.168736 18611 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 00:30:49.174398 18945 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:30:49.174588 18945 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:30:49.354712 18882 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:30:49.355126 18882 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
W20260812 00:30:49.355803 18649 tablet.cc:2369] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:30:49.358428 18882 leader_election.cc:288] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ca8b6e0c6734df08b9a295f26a3c790 (127.29.190.189:45977), df26db5e364c40918d11023145db5c2b (127.29.190.188:39751)
I20260812 00:30:49.359795 18678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21cdd06d92914563b076611f486ad88f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" is_pre_election: true
I20260812 00:30:49.360450 18678 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21cdd06d92914563b076611f486ad88f in term 0.
I20260812 00:30:49.361567 18529 leader_election.cc:302] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21cdd06d92914563b076611f486ad88f, 8ca8b6e0c6734df08b9a295f26a3c790; no voters:
I20260812 00:30:49.362345 18891 raft_consensus.cc:482] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:30:49.362649 18891 raft_consensus.cc:504] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.364529 18891 leader_election.cc:288] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21cdd06d92914563b076611f486ad88f (127.29.190.190:43175), 8ca8b6e0c6734df08b9a295f26a3c790 (127.29.190.189:45977)
I20260812 00:30:49.365924 18567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "df26db5e364c40918d11023145db5c2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21cdd06d92914563b076611f486ad88f" is_pre_election: true
I20260812 00:30:49.366494 18567 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df26db5e364c40918d11023145db5c2b in term 0.
I20260812 00:30:49.367337 18781 leader_election.cc:302] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21cdd06d92914563b076611f486ad88f, df26db5e364c40918d11023145db5c2b; no voters:
I20260812 00:30:49.368091 18678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "df26db5e364c40918d11023145db5c2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" is_pre_election: true
I20260812 00:30:49.368361 18678 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df26db5e364c40918d11023145db5c2b in term 0.
I20260812 00:30:49.369280 18891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:30:49.369428 18891 raft_consensus.cc:482] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:30:49.369525 18891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:49.371694 18882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:30:49.371886 18882 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:30:49.372040 18882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:49.375236 18819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21cdd06d92914563b076611f486ad88f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df26db5e364c40918d11023145db5c2b" is_pre_election: true
I20260812 00:30:49.378751 18882 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.379535 18891 raft_consensus.cc:504] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.380178 18819 raft_consensus.cc:2379] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21cdd06d92914563b076611f486ad88f in current term 1: Already voted for candidate df26db5e364c40918d11023145db5c2b in this term.
I20260812 00:30:49.384407 18678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "df26db5e364c40918d11023145db5c2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca8b6e0c6734df08b9a295f26a3c790"
I20260812 00:30:49.384699 18678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:49.388629 18678 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df26db5e364c40918d11023145db5c2b in term 1.
I20260812 00:30:49.389309 18781 leader_election.cc:302] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca8b6e0c6734df08b9a295f26a3c790, df26db5e364c40918d11023145db5c2b; no voters:
I20260812 00:30:49.383499 18567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "df26db5e364c40918d11023145db5c2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21cdd06d92914563b076611f486ad88f"
I20260812 00:30:49.392035 18891 leader_election.cc:288] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [CANDIDATE]: Term 1 election: Requested vote from peers 21cdd06d92914563b076611f486ad88f (127.29.190.190:43175), 8ca8b6e0c6734df08b9a295f26a3c790 (127.29.190.189:45977)
I20260812 00:30:49.392481 18567 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df26db5e364c40918d11023145db5c2b in current term 1: Already voted for candidate 21cdd06d92914563b076611f486ad88f in this term.
I20260812 00:30:49.394176 18678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21cdd06d92914563b076611f486ad88f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ca8b6e0c6734df08b9a295f26a3c790"
I20260812 00:30:49.394599 18678 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 21cdd06d92914563b076611f486ad88f in current term 1: Already voted for candidate df26db5e364c40918d11023145db5c2b in this term.
I20260812 00:30:49.395690 18891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:30:49.396124 18891 raft_consensus.cc:686] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [term 1 LEADER]: Becoming Leader. State: Replica: df26db5e364c40918d11023145db5c2b, State: Running, Role: LEADER
I20260812 00:30:49.397405 18882 leader_election.cc:288] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [CANDIDATE]: Term 1 election: Requested vote from peers 8ca8b6e0c6734df08b9a295f26a3c790 (127.29.190.189:45977), df26db5e364c40918d11023145db5c2b (127.29.190.188:39751)
I20260812 00:30:49.396987 18819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21cdd06d92914563b076611f486ad88f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df26db5e364c40918d11023145db5c2b"
I20260812 00:30:49.398303 18891 consensus_queue.cc:237] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } }
I20260812 00:30:49.425840 18951 sys_catalog.cc:455] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader df26db5e364c40918d11023145db5c2b. Latest consensus state: current_term: 1 leader_uuid: "df26db5e364c40918d11023145db5c2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.426395 18951 sys_catalog.cc:458] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:49.427511 18528 leader_election.cc:302] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21cdd06d92914563b076611f486ad88f; no voters: 8ca8b6e0c6734df08b9a295f26a3c790, df26db5e364c40918d11023145db5c2b
I20260812 00:30:49.428263 18882 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 00:30:49.436611 18955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:30:49.439287 18955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:30:49.462455 18678 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [term 1 FOLLOWER]: Refusing update from remote peer df26db5e364c40918d11023145db5c2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:30:49.463809 18951 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:30:49.471743 18567 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [term 1 FOLLOWER]: Refusing update from remote peer df26db5e364c40918d11023145db5c2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:30:49.472908 18951 consensus_queue.cc:1035] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:30:49.508809 18882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [sys.catalog]: SysCatalogTable state changed. Reason: New leader df26db5e364c40918d11023145db5c2b. Latest consensus state: current_term: 1 leader_uuid: "df26db5e364c40918d11023145db5c2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.509258 18882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:30:49.524152 18958 mvcc.cc:205] Tried to move back new op lower bound from 7317482084185313280 to 7317482083965050880. Current Snapshot: MvccSnapshot[applied={T|T < 7317482084185313280}]
I20260812 00:30:49.542824 18882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "df26db5e364c40918d11023145db5c2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.543143 18882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:30:49.544296 18891 sys_catalog.cc:455] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "df26db5e364c40918d11023145db5c2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.544665 18891 sys_catalog.cc:458] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:49.549767 18955 catalog_manager.cc:1347] Generated new cluster ID: f395026bd65a430883456e2814ba2a6d
I20260812 00:30:49.549885 18955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:30:49.578020 18929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df26db5e364c40918d11023145db5c2b. Latest consensus state: current_term: 1 leader_uuid: "df26db5e364c40918d11023145db5c2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.578357 18929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:30:49.581954 18951 sys_catalog.cc:455] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "df26db5e364c40918d11023145db5c2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.582739 18951 sys_catalog.cc:458] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:49.585486 18959 mvcc.cc:205] Tried to move back new op lower bound from 7317482084185313280 to 7317482083965050880. Current Snapshot: MvccSnapshot[applied={T|T < 7317482084185313280}]
I20260812 00:30:49.600585 18929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "df26db5e364c40918d11023145db5c2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21cdd06d92914563b076611f486ad88f" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43175 } } peers { permanent_uuid: "8ca8b6e0c6734df08b9a295f26a3c790" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 45977 } } peers { permanent_uuid: "df26db5e364c40918d11023145db5c2b" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 39751 } } }
I20260812 00:30:49.600909 18929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:30:49.601243 18955 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:30:49.603048 18955 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:30:49.620890 18955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b: Generated new TSK 0
I20260812 00:30:49.622206 18955 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:30:50.080318 18923 catalog_manager.cc:1259] Loaded cluster ID: f395026bd65a430883456e2814ba2a6d
I20260812 00:30:50.080473 18923 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: loading cluster ID for follower catalog manager: success
I20260812 00:30:50.082962 18923 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: acquiring CA information for follower catalog manager: success
I20260812 00:30:50.084813 18923 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 21cdd06d92914563b076611f486ad88f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:30:50.176751 18945 catalog_manager.cc:1259] Loaded cluster ID: f395026bd65a430883456e2814ba2a6d
I20260812 00:30:50.176892 18945 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: loading cluster ID for follower catalog manager: success
I20260812 00:30:50.179316 18945 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: acquiring CA information for follower catalog manager: success
I20260812 00:30:50.181083 18945 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8ca8b6e0c6734df08b9a295f26a3c790: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:30:50.201728 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 18499
I20260812 00:30:50.203022 18589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:50.313586 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 18499
I20260812 00:30:50.345976 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 18611
I20260812 00:30:50.347327 18720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:50.411381 18977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:50.410546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:43175 (local address 127.0.0.1:41072)
0812 00:30:50.411069 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:50.411197 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:43175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":294,"threads_started":1}
W20260812 00:30:50.411757 18781 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.190:43175: connect: Connection refused (error 111)
I20260812 00:30:50.417346 18977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:50.416969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:43175 (local address 127.0.0.1:41082)
0812 00:30:50.417146 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:50.417220 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:43175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 00:30:50.417550 18781 consensus_peers.cc:487] T 00000000000000000000000000000000 P df26db5e364c40918d11023145db5c2b -> Peer 21cdd06d92914563b076611f486ad88f (127.29.190.190:43175): Couldn't send request to peer 21cdd06d92914563b076611f486ad88f. Status: Network error: Client connection negotiation failed: client connection to 127.29.190.190:43175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 00:30:50.454559 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 18611
I20260812 00:30:50.485785 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 18739
I20260812 00:30:50.487083 18852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:50.602496 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 18739
2026-08-12T00:30:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4963 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:30:50 dist-test-slave-c12x krb5kdc[18985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:30:50 dist-test-slave-c12x krb5kdc[18985](info): set up 2 sockets
Aug 12 00:30:50 dist-test-slave-c12x krb5kdc[18985](info): commencing operation
krb5kdc: starting...
W20260812 00:30:51.964875 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:30:52 dist-test-slave-c12x krb5kdc[18985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:30:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:30:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:30:52.254743 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:44067
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:38397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:44067
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:52.608843 19007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:52.609143 19007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:52.609352 19007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:52.616693 19007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:30:52.616793 19007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:52.616888 19007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:52.616966 19007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:30:52.617034 19007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:30:52.626945 19007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:38397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:44067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:44067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:52.628283 19007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:52.629644 19007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:52.642143 19016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:52.642175 19020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:52.642201 19014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:52.643136 19007 server_base.cc:1034] running on GCE node
I20260812 00:30:52.644168 19007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:52.645684 19007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:52.646948 19007 hybrid_clock.cc:648] HybridClock initialized: now 1786494652646903 us; error 63 us; skew 500 ppm
I20260812 00:30:52.647316 19007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:52 dist-test-slave-c12x krb5kdc[18985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494652, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:52.650672 19007 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:30:52.652865 19007 webserver.cc:460] Webserver started at http://127.29.190.190:43397/ using document root <none> and password file <none>
I20260812 00:30:52.653628 19007 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:52.653780 19007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:52.654124 19007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:30:52.657388 19007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "1eaf8d9295974a7a826faa10bcf6ad4c"
format_stamp: "Formatted at 2026-08-12 00:30:52 on dist-test-slave-c12x"
server_key: "a46e85dc8ebd0507623129cb9f236d8d"
server_key_iv: "71cd6ae35bfdbb37f23a0d337c0da82b"
server_key_version: "encryptionkey@0"
I20260812 00:30:52.658197 19007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "1eaf8d9295974a7a826faa10bcf6ad4c"
format_stamp: "Formatted at 2026-08-12 00:30:52 on dist-test-slave-c12x"
server_key: "a46e85dc8ebd0507623129cb9f236d8d"
server_key_iv: "71cd6ae35bfdbb37f23a0d337c0da82b"
server_key_version: "encryptionkey@0"
I20260812 00:30:52.663791 19007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260812 00:30:52.667395 19034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:52.669371 19007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:30:52.669621 19007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "1eaf8d9295974a7a826faa10bcf6ad4c"
format_stamp: "Formatted at 2026-08-12 00:30:52 on dist-test-slave-c12x"
server_key: "a46e85dc8ebd0507623129cb9f236d8d"
server_key_iv: "71cd6ae35bfdbb37f23a0d337c0da82b"
server_key_version: "encryptionkey@0"
I20260812 00:30:52.669859 19007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:52.687948 19007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:52.692319 19007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:52.692641 19007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:52.713002 19007 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:44067
I20260812 00:30:52.713058 19118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:44067 every 8 connection(s)
I20260812 00:30:52.714583 19007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:30:52.718621 19119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:52.724299 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 19007
I20260812 00:30:52.724560 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:30:52.725237 30458 external_mini_cluster.cc:1428] Setting key 8e44aff6a4972f2d481b03e1b50947a7
I20260812 00:30:52.731751 19119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c: Bootstrap starting.
I20260812 00:30:52.735716 19119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:52.736760 19119 log.cc:824] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:52.740270 19119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c: No bootstrap required, opened a new log
Aug 12 00:30:52 dist-test-slave-c12x krb5kdc[18985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:52.749534 19119 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eaf8d9295974a7a826faa10bcf6ad4c" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44067 } }
I20260812 00:30:52.750103 19119 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:52.750222 19119 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eaf8d9295974a7a826faa10bcf6ad4c, State: Initialized, Role: FOLLOWER
I20260812 00:30:52.750981 19119 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eaf8d9295974a7a826faa10bcf6ad4c" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44067 } }
I20260812 00:30:52.751322 19119 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:30:52.751493 19119 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:30:52.751749 19119 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:52.754824 19119 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eaf8d9295974a7a826faa10bcf6ad4c" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44067 } }
I20260812 00:30:52.754933 19124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:52.727494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53518 (local address 127.29.190.190:44067)
0812 00:30:52.728486 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:52.728503 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:52.728556 (+ 53us) server_negotiation.cc:407] Connection header received
0812 00:30:52.731017 (+ 2461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:52.731050 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:52.731591 (+ 541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:52.732051 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:52.733456 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:52.735540 (+ 2084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:52.737026 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:52.737954 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:52.738088 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:52.743066 (+ 4978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:52.743077 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:52.743103 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:52.743151 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:52.750196 (+ 7045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:52.751183 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:52.751198 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:52.751206 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:52.751493 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:52.752021 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:52.752025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:52.752028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:52.752651 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:52.752885 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:52.753385 (+ 500us) server_negotiation.cc:299] Negotiation successful
0812 00:30:52.753794 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":430,"threads_started":1}
I20260812 00:30:52.755508 19119 leader_election.cc:302] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1eaf8d9295974a7a826faa10bcf6ad4c; no voters:
I20260812 00:30:52.756194 19119 leader_election.cc:288] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:30:52.756354 19126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:30:52.757607 19126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [term 1 LEADER]: Becoming Leader. State: Replica: 1eaf8d9295974a7a826faa10bcf6ad4c, State: Running, Role: LEADER
I20260812 00:30:52.758265 19126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eaf8d9295974a7a826faa10bcf6ad4c" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44067 } }
I20260812 00:30:52.758567 19119 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:30:52.759744 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:30:52.761300 19127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1eaf8d9295974a7a826faa10bcf6ad4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eaf8d9295974a7a826faa10bcf6ad4c" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44067 } } }
I20260812 00:30:52.761272 19128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eaf8d9295974a7a826faa10bcf6ad4c. Latest consensus state: current_term: 1 leader_uuid: "1eaf8d9295974a7a826faa10bcf6ad4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eaf8d9295974a7a826faa10bcf6ad4c" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 44067 } } }
I20260812 00:30:52.761795 19128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:52.761795 19127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:52.762724 19134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:30:52.769474 19134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:30:52.780342 19134 catalog_manager.cc:1347] Generated new cluster ID: 98c213907e08436b90e3b05482e699e3
I20260812 00:30:52.780476 19134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:30:52.797365 19134 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:30:52.798844 19134 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:30:52.813418 19134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1eaf8d9295974a7a826faa10bcf6ad4c: Generated new TSK 0
I20260812 00:30:52.814399 19134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:30:52.822602 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 19007
I20260812 00:30:52.823963 19107 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:52.918864 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 19007
2026-08-12T00:30:52Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2307 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:30:53 dist-test-slave-c12x krb5kdc[19161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:30:53 dist-test-slave-c12x krb5kdc[19161](info): set up 2 sockets
Aug 12 00:30:53 dist-test-slave-c12x krb5kdc[19161](info): commencing operation
krb5kdc: starting...
W20260812 00:30:54.258088 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.003s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:30:54 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:30:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:30:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:30:54.547416 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36209
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:36209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:54.900426 19183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:54.900812 19183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:54.900988 19183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:54.908537 19183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:30:54.908703 19183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:54.908819 19183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:54.908921 19183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:30:54.909008 19183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:30:54.919317 19183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:36209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:54.920797 19183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:54.922178 19183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:54.934693 19196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:54.934870 19190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:54.934958 19191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:54.935772 19183 server_base.cc:1034] running on GCE node
I20260812 00:30:54.936656 19183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:54.938239 19183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:54.939553 19183 hybrid_clock.cc:648] HybridClock initialized: now 1786494654939482 us; error 46 us; skew 500 ppm
I20260812 00:30:54.939976 19183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:54 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494654, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:54.943344 19183 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:30:54.945263 19183 webserver.cc:460] Webserver started at http://127.29.190.190:45835/ using document root <none> and password file <none>
I20260812 00:30:54.946236 19183 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:54.946400 19183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:54.946767 19183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:30:54.950206 19183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "f833f82c9395441b85d91a40a9a5051e"
format_stamp: "Formatted at 2026-08-12 00:30:54 on dist-test-slave-c12x"
server_key: "f19497bd0044111db103313ccd57eb77"
server_key_iv: "3340f308fb2df77f3ebbb3eaad0b8fc4"
server_key_version: "encryptionkey@0"
I20260812 00:30:54.951112 19183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "f833f82c9395441b85d91a40a9a5051e"
format_stamp: "Formatted at 2026-08-12 00:30:54 on dist-test-slave-c12x"
server_key: "f19497bd0044111db103313ccd57eb77"
server_key_iv: "3340f308fb2df77f3ebbb3eaad0b8fc4"
server_key_version: "encryptionkey@0"
I20260812 00:30:54.956974 19183 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 00:30:54.960956 19207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:54.962430 19183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:30:54.962631 19183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "f833f82c9395441b85d91a40a9a5051e"
format_stamp: "Formatted at 2026-08-12 00:30:54 on dist-test-slave-c12x"
server_key: "f19497bd0044111db103313ccd57eb77"
server_key_iv: "3340f308fb2df77f3ebbb3eaad0b8fc4"
server_key_version: "encryptionkey@0"
I20260812 00:30:54.962857 19183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:54.980335 19183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:54.985210 19183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:54.985548 19183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:55.005511 19183 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:36209
I20260812 00:30:55.005543 19292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:36209 every 8 connection(s)
I20260812 00:30:55.007064 19183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:30:55.010924 19293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:55.016413 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 19183
I20260812 00:30:55.016662 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:30:55.017535 30458 external_mini_cluster.cc:1428] Setting key dbbebd972a6e3b379b291b16e77dc15d
I20260812 00:30:55.022986 19293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Bootstrap starting.
I20260812 00:30:55.026443 19293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:55.027688 19293 log.cc:824] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:55.031477 19293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: No bootstrap required, opened a new log
Aug 12 00:30:55 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:55.041297 19293 raft_consensus.cc:348] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:30:55.041858 19293 raft_consensus.cc:374] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:55.042001 19293 raft_consensus.cc:729] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f833f82c9395441b85d91a40a9a5051e, State: Initialized, Role: FOLLOWER
I20260812 00:30:55.042644 19293 consensus_queue.cc:260] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:30:55.042917 19293 raft_consensus.cc:388] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:30:55.043084 19293 raft_consensus.cc:482] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:30:55.043262 19293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:55.043524 19296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:55.019963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48624 (local address 127.29.190.190:36209)
0812 00:30:55.020893 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:55.020907 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:55.020956 (+ 49us) server_negotiation.cc:407] Connection header received
0812 00:30:55.022665 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:55.022690 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:55.023158 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:55.023628 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:55.025405 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:55.026980 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:55.028883 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:55.030006 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:55.030213 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:55.035089 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:55.035098 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:55.035114 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:55.035163 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:55.038615 (+ 3452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:55.039597 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:55.039604 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:55.039611 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:55.039789 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:55.040218 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:55.040221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:55.040223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:55.040838 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:55.041073 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:55.041610 (+ 537us) server_negotiation.cc:299] Negotiation successful
0812 00:30:55.042122 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":457,"threads_started":1}
I20260812 00:30:55.045907 19293 raft_consensus.cc:504] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:30:55.046569 19293 leader_election.cc:302] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f833f82c9395441b85d91a40a9a5051e; no voters:
I20260812 00:30:55.047250 19293 leader_election.cc:288] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:30:55.047395 19298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:30:55.048326 19298 raft_consensus.cc:686] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 1 LEADER]: Becoming Leader. State: Replica: f833f82c9395441b85d91a40a9a5051e, State: Running, Role: LEADER
I20260812 00:30:55.048851 19298 consensus_queue.cc:237] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:30:55.049666 19293 sys_catalog.cc:564] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:30:55.052098 19300 sys_catalog.cc:455] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f833f82c9395441b85d91a40a9a5051e. Latest consensus state: current_term: 1 leader_uuid: "f833f82c9395441b85d91a40a9a5051e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } } }
I20260812 00:30:55.052119 19299 sys_catalog.cc:455] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f833f82c9395441b85d91a40a9a5051e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } } }
I20260812 00:30:55.052554 19300 sys_catalog.cc:458] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:55.052554 19299 sys_catalog.cc:458] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:55.057428 19306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:30:55.063385 19306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:30:55.074644 19306 catalog_manager.cc:1347] Generated new cluster ID: f0205aca69294caea05f572db3516d6e
I20260812 00:30:55.074767 19306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:30:55.084939 19306 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:30:55.086510 19306 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:30:55.093729 19306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Generated new TSK 0
I20260812 00:30:55.094714 19306 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:30:55.180321 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36209
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:55.569958 19334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:55.570304 19334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:55.570472 19334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:55.578022 19334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:55.578169 19334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:55.578362 19334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:30:55.588512 19334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:55.589993 19334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:55.591583 19334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:55.605643 19345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:55.605614 19347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:55.605777 19351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:55.606855 19334 server_base.cc:1034] running on GCE node
I20260812 00:30:55.607597 19334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:55.608594 19334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:55.609836 19334 hybrid_clock.cc:648] HybridClock initialized: now 1786494655609793 us; error 35 us; skew 500 ppm
I20260812 00:30:55.610204 19334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:55 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494655, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:55.613554 19334 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:30:55.616539 19334 webserver.cc:460] Webserver started at http://127.29.190.129:37263/ using document root <none> and password file <none>
I20260812 00:30:55.617560 19334 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:55.617714 19334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:55.618167 19334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:30:55.622234 19334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "220748cbd097442a8a5c62f42089bc07"
format_stamp: "Formatted at 2026-08-12 00:30:55 on dist-test-slave-c12x"
server_key: "66692490a5d9c2a21d287930d45dd8cb"
server_key_iv: "3f8549416716d55f56613da1519a2b2c"
server_key_version: "encryptionkey@0"
I20260812 00:30:55.623503 19334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "220748cbd097442a8a5c62f42089bc07"
format_stamp: "Formatted at 2026-08-12 00:30:55 on dist-test-slave-c12x"
server_key: "66692490a5d9c2a21d287930d45dd8cb"
server_key_iv: "3f8549416716d55f56613da1519a2b2c"
server_key_version: "encryptionkey@0"
I20260812 00:30:55.631484 19334 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.002s
I20260812 00:30:55.638306 19366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:55.640141 19334 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.004s
I20260812 00:30:55.640425 19334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "220748cbd097442a8a5c62f42089bc07"
format_stamp: "Formatted at 2026-08-12 00:30:55 on dist-test-slave-c12x"
server_key: "66692490a5d9c2a21d287930d45dd8cb"
server_key_iv: "3f8549416716d55f56613da1519a2b2c"
server_key_version: "encryptionkey@0"
I20260812 00:30:55.640877 19334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:55.677124 19334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:55.681687 19334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:55.682013 19334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:55.683053 19334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:55.684635 19334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:55.684742 19334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:55.684896 19334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:55.684978 19334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:55.720443 19334 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:39051
I20260812 00:30:55.720542 19552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:39051 every 8 connection(s)
I20260812 00:30:55.721812 19334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:30:55.725239 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 19334
I20260812 00:30:55.725483 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:30:55.726491 30458 external_mini_cluster.cc:1428] Setting key 4c430eba8ff3e8883702531afe77f2e1
Aug 12 00:30:55 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494655, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:55.746543 19559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:55.724680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:43123 (local address 127.29.190.190:36209)
0812 00:30:55.725266 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:55.725273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:55.726420 (+ 1147us) server_negotiation.cc:407] Connection header received
0812 00:30:55.729008 (+ 2588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:55.729014 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:55.729120 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:55.729266 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:55.731685 (+ 2419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:55.732413 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:55.735275 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:55.735785 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:55.735902 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:55.740642 (+ 4740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:55.740647 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:55.740650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:55.740683 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:55.743313 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:55.744104 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:55.744114 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:55.744117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:55.744232 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:55.744680 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:55.744685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:55.744690 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:55.744963 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:55.745129 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:55.745916 (+ 787us) server_negotiation.cc:299] Negotiation successful
0812 00:30:55.746141 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":287,"threads_started":1}
I20260812 00:30:55.747752 19562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:55.725183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:43123)
0812 00:30:55.726179 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:55.726257 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:55.728608 (+ 2351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:55.729591 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:55.729603 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:55.730514 (+ 911us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:55.731481 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:55.731514 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:55.732595 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:55.732604 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:55.735073 (+ 2469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:55.735094 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:55.736067 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:55.736079 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:55.736464 (+ 385us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:55.737278 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:55.737317 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:55.740392 (+ 3075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:55.743491 (+ 3099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:55.743501 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:55.743520 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:55.743960 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:55.744349 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:55.744354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:55.744357 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:55.744555 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:55.745106 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:55.745114 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:55.745469 (+ 355us) client_negotiation.cc:769] Sending connection context
0812 00:30:55.745807 (+ 338us) client_negotiation.cc:240] Negotiation successful
0812 00:30:55.746366 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":371,"threads_started":1}
I20260812 00:30:55.749521 19555 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36209
I20260812 00:30:55.749882 19555 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:55.750888 19555 heartbeater.cc:511] Master 127.29.190.190:36209 requested a full tablet report, sending...
I20260812 00:30:55.753743 19239 ts_manager.cc:194] Registered new tserver with Master: 220748cbd097442a8a5c62f42089bc07 (127.29.190.129:39051)
I20260812 00:30:55.756402 19239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:43123
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:30:55.795827 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36209
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:56.143987 19565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:56.144315 19565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:56.144484 19565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:56.152375 19565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:56.152539 19565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:56.152722 19565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:30:56.163044 19565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:56.164453 19565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:56.165935 19565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:56.180555 19573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:56.180491 19574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:56.180503 19577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:56.181720 19565 server_base.cc:1034] running on GCE node
I20260812 00:30:56.182349 19565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:56.183338 19565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:56.184599 19565 hybrid_clock.cc:648] HybridClock initialized: now 1786494656184544 us; error 37 us; skew 500 ppm
I20260812 00:30:56.184948 19565 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:56 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494656, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:56.188334 19565 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:30:56.189976 19565 webserver.cc:460] Webserver started at http://127.29.190.130:46097/ using document root <none> and password file <none>
I20260812 00:30:56.190744 19565 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:56.190898 19565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:56.191226 19565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:30:56.194552 19565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "e67e2a01a0ac41348009e046c93915ab"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "f2c4e0f1e5885909eaf28eef3f86c6da"
server_key_iv: "432e18156d6380b3d671e82235b72c96"
server_key_version: "encryptionkey@0"
I20260812 00:30:56.195377 19565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "e67e2a01a0ac41348009e046c93915ab"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "f2c4e0f1e5885909eaf28eef3f86c6da"
server_key_iv: "432e18156d6380b3d671e82235b72c96"
server_key_version: "encryptionkey@0"
I20260812 00:30:56.200870 19565 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:30:56.204568 19591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:56.205983 19565 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:30:56.206157 19565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "e67e2a01a0ac41348009e046c93915ab"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "f2c4e0f1e5885909eaf28eef3f86c6da"
server_key_iv: "432e18156d6380b3d671e82235b72c96"
server_key_version: "encryptionkey@0"
I20260812 00:30:56.206359 19565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:56.223608 19565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:56.227804 19565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:56.228106 19565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:56.229075 19565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:56.230891 19565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:56.230993 19565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:56.231123 19565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:56.231204 19565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:56.265487 19565 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:37085
I20260812 00:30:56.265537 19769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:37085 every 8 connection(s)
I20260812 00:30:56.266867 19565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:30:56.274951 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 19565
I20260812 00:30:56.275166 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:30:56.275671 30458 external_mini_cluster.cc:1428] Setting key d8eecadbcfa27323c0d8a4c515acecf0
Aug 12 00:30:56 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494656, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:56.288668 19775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.269569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:49941 (local address 127.29.190.190:36209)
0812 00:30:56.270058 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:56.270063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:56.270806 (+ 743us) server_negotiation.cc:407] Connection header received
0812 00:30:56.272699 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:56.272704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:56.272794 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:56.272928 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:56.274427 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.275284 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.277066 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.277605 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.277705 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.281346 (+ 3641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:56.281355 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:56.281363 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:56.281412 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:56.285223 (+ 3811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:56.286041 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:56.286049 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:56.286055 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:56.286219 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:56.286666 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:56.286674 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:56.286679 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:56.287097 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:56.287253 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:56.288101 (+ 848us) server_negotiation.cc:299] Negotiation successful
0812 00:30:56.288366 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":266,"threads_started":1}
I20260812 00:30:56.289970 19776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.269917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:49941)
0812 00:30:56.270640 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:56.270685 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:56.272414 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:56.273179 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:56.273187 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:56.273699 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:56.274249 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.274266 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.275476 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.275482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.276911 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.276925 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.277863 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.277872 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.278106 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.278820 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:56.278843 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:56.281100 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:56.285437 (+ 4337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:56.285444 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:56.285456 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:56.285898 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:56.286333 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:56.286336 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:56.286339 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:56.286547 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:56.287227 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:56.287233 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:56.287677 (+ 444us) client_negotiation.cc:769] Sending connection context
0812 00:30:56.287949 (+ 272us) client_negotiation.cc:240] Negotiation successful
0812 00:30:56.288405 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":276,"threads_started":1}
I20260812 00:30:56.291527 19771 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36209
I20260812 00:30:56.291854 19771 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:56.292889 19771 heartbeater.cc:511] Master 127.29.190.190:36209 requested a full tablet report, sending...
I20260812 00:30:56.294538 19239 ts_manager.cc:194] Registered new tserver with Master: e67e2a01a0ac41348009e046c93915ab (127.29.190.130:37085)
I20260812 00:30:56.295362 19239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:49941
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:30:56.339761 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36209
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:56.688974 19782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:56.689373 19782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:56.689563 19782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:56.697049 19782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:56.697224 19782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:56.697407 19782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:30:56.707702 19782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:56.709070 19782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:56.710498 19782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:56.723781 19792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:56.724023 19790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:56.724282 19794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:56.725138 19782 server_base.cc:1034] running on GCE node
I20260812 00:30:56.725795 19782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:56.726791 19782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:56.728014 19782 hybrid_clock.cc:648] HybridClock initialized: now 1786494656727926 us; error 79 us; skew 500 ppm
I20260812 00:30:56.728319 19782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:56 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494656, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:56.731711 19782 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:30:56.733184 19782 webserver.cc:460] Webserver started at http://127.29.190.131:42417/ using document root <none> and password file <none>
I20260812 00:30:56.733860 19782 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:56.733960 19782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:56.734220 19782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:30:56.737258 19782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "309743121dea4633862118b72eea8b64"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "299123ead716aa2dcef4b8c19f6ab5da"
server_key_iv: "2762b5f8114e6310e8fdfc34b608f0fb"
server_key_version: "encryptionkey@0"
I20260812 00:30:56.738003 19782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "309743121dea4633862118b72eea8b64"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "299123ead716aa2dcef4b8c19f6ab5da"
server_key_iv: "2762b5f8114e6310e8fdfc34b608f0fb"
server_key_version: "encryptionkey@0"
I20260812 00:30:56.743109 19782 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:30:56.746609 19807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:56.748409 19782 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 00:30:56.748558 19782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "309743121dea4633862118b72eea8b64"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "299123ead716aa2dcef4b8c19f6ab5da"
server_key_iv: "2762b5f8114e6310e8fdfc34b608f0fb"
server_key_version: "encryptionkey@0"
I20260812 00:30:56.748728 19782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:56.760622 19555 heartbeater.cc:503] Master 127.29.190.190:36209 was elected leader, sending a full tablet report...
I20260812 00:30:56.762164 19782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:56.766782 19782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:56.767103 19782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:56.768247 19782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:56.769726 19782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:56.769833 19782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:56.769985 19782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:56.770064 19782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:56.803699 19782 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:42925
I20260812 00:30:56.803735 19992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:42925 every 8 connection(s)
I20260812 00:30:56.805013 19782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:30:56.808499 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 19782
I20260812 00:30:56.808704 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:30:56.809284 30458 external_mini_cluster.cc:1428] Setting key 03bb09c0fd3c8007e4de92ebb5409ff0
Aug 12 00:30:56 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494656, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:56.824898 19996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.807573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:46997 (local address 127.29.190.190:36209)
0812 00:30:56.808046 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:56.808051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:56.808988 (+ 937us) server_negotiation.cc:407] Connection header received
0812 00:30:56.811136 (+ 2148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:56.811142 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:56.811236 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:56.811369 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:56.812944 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.813734 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.815306 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.815809 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.815952 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.819328 (+ 3376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:56.819333 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:56.819336 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:56.819377 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:56.821796 (+ 2419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:56.822514 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:56.822521 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:56.822527 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:56.822657 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:56.823093 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:56.823099 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:56.823102 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:56.823401 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:56.823608 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:56.824291 (+ 683us) server_negotiation.cc:299] Negotiation successful
0812 00:30:56.824516 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":251,"threads_started":1}
I20260812 00:30:56.825826 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.807972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:46997)
0812 00:30:56.808821 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:56.808868 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:56.810876 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:56.811636 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:56.811644 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:56.812179 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:56.812769 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.812787 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.813905 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.813909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.815154 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.815167 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.816043 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.816050 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.816281 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.816908 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:56.816928 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:56.819119 (+ 2191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:56.821948 (+ 2829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:56.821958 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:56.821974 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:56.822392 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:56.822775 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:56.822780 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:56.822784 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:56.822976 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:56.823562 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:56.823571 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:56.823919 (+ 348us) client_negotiation.cc:769] Sending connection context
0812 00:30:56.824189 (+ 270us) client_negotiation.cc:240] Negotiation successful
0812 00:30:56.824733 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":324,"threads_started":1}
I20260812 00:30:56.827076 19993 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36209
I20260812 00:30:56.827399 19993 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:56.828192 19993 heartbeater.cc:511] Master 127.29.190.190:36209 requested a full tablet report, sending...
I20260812 00:30:56.829767 19239 ts_manager.cc:194] Registered new tserver with Master: 309743121dea4633862118b72eea8b64 (127.29.190.131:42925)
I20260812 00:30:56.830770 19239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:46997
I20260812 00:30:56.836977 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:30:56.855994 19996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.841793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42878 (local address 127.29.190.190:36209)
0812 00:30:56.842058 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:56.842069 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:56.842489 (+ 420us) server_negotiation.cc:407] Connection header received
0812 00:30:56.842624 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:56.842629 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:56.842701 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:56.842792 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:56.844302 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.845161 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.846581 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.847033 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.847139 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.849744 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:56.849750 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:56.849754 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:56.849790 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:56.852768 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:56.853557 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:56.853563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:56.853568 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:56.853763 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:56.854242 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:56.854247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:56.854250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:56.854737 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:56.855018 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:56.855352 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 00:30:56.855636 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:30:56.860581 19239 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:30:56.867929 19239 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:30:56.903802 20012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.881142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:37085 (local address 127.0.0.1:35954)
0812 00:30:56.894771 (+ 13629us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:56.894795 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:56.894907 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:56.895649 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:56.895659 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:56.895690 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:56.896116 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.896130 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.898386 (+ 2256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.898398 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.900873 (+ 2475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.900886 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.902643 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.902649 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.902836 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.902887 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 00:30:56.903043 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 00:30:56.903246 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13510,"mutex_wait_us":30,"thread_start_us":12378,"threads_started":1}
I20260812 00:30:56.904031 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.881271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42180 (local address 127.29.190.131:42925)
0812 00:30:56.895748 (+ 14477us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:56.895758 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:56.895794 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:30:56.895886 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:56.895893 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:56.896130 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:56.896323 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:56.897387 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.898708 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.901467 (+ 2759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.902856 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.903092 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.903260 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:56.903524 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 00:30:56.903694 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14297,"thread_start_us":14090,"threads_started":1}
I20260812 00:30:56.904469 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.880781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:42925 (local address 127.0.0.1:42180)
0812 00:30:56.893980 (+ 13199us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:56.894043 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:56.894248 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:56.896540 (+ 2292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:56.896547 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:56.896580 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:56.897185 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.897196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.898946 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.898953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.901289 (+ 2336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.901305 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.903092 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.903098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.903286 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.903320 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:30:56.903441 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:30:56.903611 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12911,"mutex_wait_us":63,"thread_start_us":14085,"threads_started":1}
I20260812 00:30:56.905067 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.896448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47620)
0812 00:30:56.897230 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:56.897248 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:56.897360 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:56.897978 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:56.897983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:56.898008 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:56.898359 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.898370 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.900346 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.900351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.902151 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:56.902163 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.904304 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.904309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:56.904452 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.904512 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 00:30:56.904621 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 00:30:56.904740 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":39,"thread_start_us":381,"threads_started":1}
I20260812 00:30:56.905782 20018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.895745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47620 (local address 127.29.190.129:39051)
0812 00:30:56.896430 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:56.896438 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:56.897476 (+ 1038us) server_negotiation.cc:407] Connection header received
0812 00:30:56.897570 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:56.897577 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:56.897787 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:56.897954 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:56.898557 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.900196 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.902316 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.903760 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.903978 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.904170 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:56.905281 (+ 1111us) server_negotiation.cc:299] Negotiation successful
0812 00:30:56.905470 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":366,"threads_started":1}
I20260812 00:30:56.906284 20014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:56.881188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35954 (local address 127.29.190.130:37085)
0812 00:30:56.894905 (+ 13717us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:56.894915 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:56.894948 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:30:56.895053 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:56.895063 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:56.895340 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:56.896348 (+ 1008us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:56.896633 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.898249 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.901048 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:56.902435 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:56.902630 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:56.902825 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:56.903917 (+ 1092us) server_negotiation.cc:299] Negotiation successful
0812 00:30:56.905944 (+ 2027us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13516,"thread_start_us":13818,"threads_started":1}
I20260812 00:30:56.908874 19882 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb19982ebb64d2aaa7635e4ced34541 (DEFAULT_TABLE table=test-table [id=3de58ff09be34ab5b67263644cfb5dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:56.909164 19660 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb19982ebb64d2aaa7635e4ced34541 (DEFAULT_TABLE table=test-table [id=3de58ff09be34ab5b67263644cfb5dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:56.909606 19443 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb19982ebb64d2aaa7635e4ced34541 (DEFAULT_TABLE table=test-table [id=3de58ff09be34ab5b67263644cfb5dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:56.910468 19882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb19982ebb64d2aaa7635e4ced34541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:56.910492 19660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb19982ebb64d2aaa7635e4ced34541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:56.910921 19443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb19982ebb64d2aaa7635e4ced34541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:56.923132 20020 tablet_bootstrap.cc:492] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Bootstrap starting.
I20260812 00:30:56.925933 20021 tablet_bootstrap.cc:492] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Bootstrap starting.
I20260812 00:30:56.927796 20020 tablet_bootstrap.cc:654] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:56.928552 20022 tablet_bootstrap.cc:492] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Bootstrap starting.
I20260812 00:30:56.929592 20020 log.cc:824] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:56.930253 20021 tablet_bootstrap.cc:654] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:56.931813 20021 log.cc:824] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:56.932118 20022 tablet_bootstrap.cc:654] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:56.933542 20022 log.cc:824] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:56.934947 20020 tablet_bootstrap.cc:492] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: No bootstrap required, opened a new log
I20260812 00:30:56.935293 20020 ts_tablet_manager.cc:1397] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.001s
I20260812 00:30:56.935948 20021 tablet_bootstrap.cc:492] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: No bootstrap required, opened a new log
I20260812 00:30:56.936249 20021 ts_tablet_manager.cc:1397] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260812 00:30:56.936370 20022 tablet_bootstrap.cc:492] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: No bootstrap required, opened a new log
I20260812 00:30:56.936620 20022 ts_tablet_manager.cc:1397] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 00:30:56.944052 20022 raft_consensus.cc:348] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:56.944471 20022 raft_consensus.cc:374] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:56.944586 20022 raft_consensus.cc:729] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220748cbd097442a8a5c62f42089bc07, State: Initialized, Role: FOLLOWER
I20260812 00:30:56.945259 20022 consensus_queue.cc:260] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:56.946465 20020 raft_consensus.cc:348] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:56.946967 20020 raft_consensus.cc:374] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:56.947084 20020 raft_consensus.cc:729] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e67e2a01a0ac41348009e046c93915ab, State: Initialized, Role: FOLLOWER
I20260812 00:30:56.947945 20022 ts_tablet_manager.cc:1428] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Time spent starting tablet: real 0.011s user 0.007s sys 0.005s
I20260812 00:30:56.947788 20020 consensus_queue.cc:260] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:56.948148 20021 raft_consensus.cc:348] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:56.948665 20021 raft_consensus.cc:374] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:56.949206 19771 heartbeater.cc:503] Master 127.29.190.190:36209 was elected leader, sending a full tablet report...
I20260812 00:30:56.948773 20021 raft_consensus.cc:729] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 309743121dea4633862118b72eea8b64, State: Initialized, Role: FOLLOWER
I20260812 00:30:56.949972 20020 ts_tablet_manager.cc:1428] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Time spent starting tablet: real 0.014s user 0.014s sys 0.003s
I20260812 00:30:56.950166 20021 consensus_queue.cc:260] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:56.951494 19993 heartbeater.cc:503] Master 127.29.190.190:36209 was elected leader, sending a full tablet report...
I20260812 00:30:56.952311 20021 ts_tablet_manager.cc:1428] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Time spent starting tablet: real 0.016s user 0.013s sys 0.001s
W20260812 00:30:56.974354 19557 tablet.cc:2369] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:30:57.019114 19774 tablet.cc:2369] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:30:57.056845 19994 tablet.cc:2369] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:30:57.058091 20037 raft_consensus.cc:482] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:30:57.058390 20037 raft_consensus.cc:504] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:57.060374 20037 leader_election.cc:288] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 309743121dea4633862118b72eea8b64 (127.29.190.131:42925), e67e2a01a0ac41348009e046c93915ab (127.29.190.130:37085)
I20260812 00:30:57.067757 20014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:57.061003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51861 (local address 127.29.190.130:37085)
0812 00:30:57.061484 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:57.061490 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:57.062076 (+ 586us) server_negotiation.cc:407] Connection header received
0812 00:30:57.062259 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:57.062264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:57.062346 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:57.062452 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:57.063142 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.063958 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.065788 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.066772 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.066927 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:57.067003 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:57.067336 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 00:30:57.067486 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332}
I20260812 00:30:57.067788 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:57.060939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:57351 (local address 127.29.190.131:42925)
0812 00:30:57.061311 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:57.061317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:57.061854 (+ 537us) server_negotiation.cc:407] Connection header received
0812 00:30:57.062053 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:57.062058 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:57.062135 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:57.062239 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:57.062942 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.063776 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.065827 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.066690 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.066811 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:57.066907 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:57.067367 (+ 460us) server_negotiation.cc:299] Negotiation successful
0812 00:30:57.067557 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260812 00:30:57.067889 20042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:57.060663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:37085 (local address 127.29.190.129:51861)
0812 00:30:57.061932 (+ 1269us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:57.061946 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:57.062102 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:57.062489 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:57.062492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:57.062513 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:57.062965 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:57.062979 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.064120 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.064124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:57.065633 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:57.065647 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.067015 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.067019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:57.067140 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:57.067205 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 00:30:57.067306 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:30:57.067433 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1117,"mutex_wait_us":64,"thread_start_us":597,"threads_started":1}
I20260812 00:30:57.068022 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:57.060616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:42925 (local address 127.29.190.129:57351)
0812 00:30:57.061724 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:57.061743 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:57.061900 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:57.062267 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:57.062272 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:57.062307 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:57.062778 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:57.062790 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.063904 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.063912 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:57.065650 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:57.065662 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.066901 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.066907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:57.067095 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:57.067214 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 00:30:57.067320 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:30:57.067525 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"mutex_wait_us":135,"thread_start_us":990,"threads_started":1}
I20260812 00:30:57.069169 19911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb19982ebb64d2aaa7635e4ced34541" candidate_uuid: "220748cbd097442a8a5c62f42089bc07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "309743121dea4633862118b72eea8b64" is_pre_election: true
I20260812 00:30:57.069305 19694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb19982ebb64d2aaa7635e4ced34541" candidate_uuid: "220748cbd097442a8a5c62f42089bc07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e67e2a01a0ac41348009e046c93915ab" is_pre_election: true
I20260812 00:30:57.069744 19911 raft_consensus.cc:2454] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 220748cbd097442a8a5c62f42089bc07 in term 0.
I20260812 00:30:57.069829 19694 raft_consensus.cc:2454] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 220748cbd097442a8a5c62f42089bc07 in term 0.
I20260812 00:30:57.070518 19374 leader_election.cc:302] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220748cbd097442a8a5c62f42089bc07, 309743121dea4633862118b72eea8b64; no voters:
I20260812 00:30:57.070906 20037 raft_consensus.cc:2781] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:30:57.071054 20037 raft_consensus.cc:482] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:30:57.071192 20037 raft_consensus.cc:3037] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:57.073462 20037 raft_consensus.cc:504] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:57.074122 20037 leader_election.cc:288] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [CANDIDATE]: Term 1 election: Requested vote from peers 309743121dea4633862118b72eea8b64 (127.29.190.131:42925), e67e2a01a0ac41348009e046c93915ab (127.29.190.130:37085)
I20260812 00:30:57.074594 19694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb19982ebb64d2aaa7635e4ced34541" candidate_uuid: "220748cbd097442a8a5c62f42089bc07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e67e2a01a0ac41348009e046c93915ab"
I20260812 00:30:57.074800 19694 raft_consensus.cc:3037] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:57.077004 19694 raft_consensus.cc:2454] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220748cbd097442a8a5c62f42089bc07 in term 1.
I20260812 00:30:57.077348 19911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb19982ebb64d2aaa7635e4ced34541" candidate_uuid: "220748cbd097442a8a5c62f42089bc07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "309743121dea4633862118b72eea8b64"
I20260812 00:30:57.077406 19372 leader_election.cc:302] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220748cbd097442a8a5c62f42089bc07, e67e2a01a0ac41348009e046c93915ab; no voters:
I20260812 00:30:57.077584 19911 raft_consensus.cc:3037] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:30:57.077725 20037 raft_consensus.cc:2781] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:30:57.078230 20037 raft_consensus.cc:686] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 1 LEADER]: Becoming Leader. State: Replica: 220748cbd097442a8a5c62f42089bc07, State: Running, Role: LEADER
I20260812 00:30:57.078759 20037 consensus_queue.cc:237] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } }
I20260812 00:30:57.080235 19911 raft_consensus.cc:2454] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 220748cbd097442a8a5c62f42089bc07 in term 1.
I20260812 00:30:57.083171 19232 catalog_manager.cc:5495] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 220748cbd097442a8a5c62f42089bc07 (127.29.190.129). New cstate: current_term: 1 leader_uuid: "220748cbd097442a8a5c62f42089bc07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } health_report { overall_health: HEALTHY } } }
I20260812 00:30:57.133064 20018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:57.127535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47624 (local address 127.29.190.129:39051)
0812 00:30:57.127747 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:57.127754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:57.127818 (+ 64us) server_negotiation.cc:407] Connection header received
0812 00:30:57.127936 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:57.127940 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:57.128026 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:57.128208 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:30:57.128619 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.129335 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.130688 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.131104 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.131243 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:57.131847 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:30:57.132451 (+ 604us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:30:57.132619 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:57.132681 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 00:30:57.132763 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:30:57.141971 19694 raft_consensus.cc:1261] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 1 FOLLOWER]: Refusing update from remote peer 220748cbd097442a8a5c62f42089bc07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:30:57.141980 19911 raft_consensus.cc:1261] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 1 FOLLOWER]: Refusing update from remote peer 220748cbd097442a8a5c62f42089bc07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:30:57.142994 20045 consensus_queue.cc:1035] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:30:57.143350 20037 consensus_queue.cc:1035] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:30:57.155066 20049 mvcc.cc:205] Tried to move back new op lower bound from 7317482115642642432 to 7317482115398270976. Current Snapshot: MvccSnapshot[applied={T|T < 7317482115642642432}]
I20260812 00:30:57.168227 19232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:30:57.168506 19232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:30:57.171940 19232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Sending DeleteTablet for 3 replicas of tablet 8fb19982ebb64d2aaa7635e4ced34541
I20260812 00:30:57.173162 19660 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fb19982ebb64d2aaa7635e4ced34541 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:30:57 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:35954
I20260812 00:30:57.173208 19443 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fb19982ebb64d2aaa7635e4ced34541 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:30:57 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:47620
I20260812 00:30:57.173910 19882 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fb19982ebb64d2aaa7635e4ced34541 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:30:57 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:42180
I20260812 00:30:57.174160 20064 tablet_replica.cc:330] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: stopping tablet replica
I20260812 00:30:57.174633 20064 raft_consensus.cc:2229] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:30:57.174948 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 19334
I20260812 00:30:57.175341 20064 raft_consensus.cc:2258] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:30:57.177945 20064 ts_tablet_manager.cc:1905] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:30:57.187063 20064 ts_tablet_manager.cc:1918] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:30:57.187394 20064 log.cc:1196] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/8fb19982ebb64d2aaa7635e4ced34541
I20260812 00:30:57.188165 20064 ts_tablet_manager.cc:1939] T 8fb19982ebb64d2aaa7635e4ced34541 P e67e2a01a0ac41348009e046c93915ab: Deleting consensus metadata
I20260812 00:30:57.190697 19212 catalog_manager.cc:4841] TS e67e2a01a0ac41348009e046c93915ab (127.29.190.130:37085): tablet 8fb19982ebb64d2aaa7635e4ced34541 (table test-table [id=3de58ff09be34ab5b67263644cfb5dae]) successfully deleted
I20260812 00:30:57.192871 20067 tablet_replica.cc:330] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: stopping tablet replica
I20260812 00:30:57.193506 20067 raft_consensus.cc:2229] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:30:57.194171 20067 raft_consensus.cc:2258] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:30:57.196770 20067 ts_tablet_manager.cc:1905] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:30:57.200070 20066 tablet_replica.cc:330] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: stopping tablet replica
I20260812 00:30:57.200651 20066 raft_consensus.cc:2229] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:30:57.201483 20066 raft_consensus.cc:2258] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:30:57.203989 20066 ts_tablet_manager.cc:1905] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 00:30:57 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:30:57.204979 20067 ts_tablet_manager.cc:1918] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:30:57.205179 20067 log.cc:1196] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/8fb19982ebb64d2aaa7635e4ced34541
I20260812 00:30:57.205727 20067 ts_tablet_manager.cc:1939] T 8fb19982ebb64d2aaa7635e4ced34541 P 309743121dea4633862118b72eea8b64: Deleting consensus metadata
I20260812 00:30:57.208083 19213 catalog_manager.cc:4841] TS 309743121dea4633862118b72eea8b64 (127.29.190.131:42925): tablet 8fb19982ebb64d2aaa7635e4ced34541 (table test-table [id=3de58ff09be34ab5b67263644cfb5dae]) successfully deleted
I20260812 00:30:57.212335 20066 ts_tablet_manager.cc:1918] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:30:57.212532 20066 log.cc:1196] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/8fb19982ebb64d2aaa7635e4ced34541
I20260812 00:30:57.213068 20066 ts_tablet_manager.cc:1939] T 8fb19982ebb64d2aaa7635e4ced34541 P 220748cbd097442a8a5c62f42089bc07: Deleting consensus metadata
I20260812 00:30:57.214349 20018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:57.176452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47630 (local address 127.29.190.129:39051)
0812 00:30:57.176640 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:57.176647 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:57.192178 (+ 15531us) server_negotiation.cc:407] Connection header received
0812 00:30:57.192407 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:57.192415 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:57.192533 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:57.192636 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:57.194844 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.196082 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.198154 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.198883 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.198981 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:57.205824 (+ 6843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:57.205840 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:57.205857 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:57.205913 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:57.210351 (+ 4438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:57.211374 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:57.211384 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:57.211387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:57.211600 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:57.212037 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:57.212049 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:57.212052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:57.212526 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:57.212866 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:57.213493 (+ 627us) server_negotiation.cc:299] Negotiation successful
0812 00:30:57.213756 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:30:57.214892 19213 catalog_manager.cc:4841] TS 220748cbd097442a8a5c62f42089bc07 (127.29.190.129:39051): tablet 8fb19982ebb64d2aaa7635e4ced34541 (table test-table [id=3de58ff09be34ab5b67263644cfb5dae]) successfully deleted
I20260812 00:30:57.215039 19548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:57.313935 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 19334
I20260812 00:30:57.341717 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 19565
Aug 12 00:30:57 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:30:57.363358 20014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:57.342525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35956 (local address 127.29.190.130:37085)
0812 00:30:57.342723 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:57.342730 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:57.342751 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:30:57.342943 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:57.342948 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:57.343038 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:57.343151 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:57.344586 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.345356 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.346641 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.347030 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.347169 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:57.356612 (+ 9443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:57.356629 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:57.356647 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:57.356695 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:57.360383 (+ 3688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:57.361230 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:57.361238 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:57.361241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:57.361389 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:57.361810 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:57.361813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:57.361815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:57.362248 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:57.362507 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:57.362810 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 00:30:57.362987 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:30:57.364207 19765 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:57.458168 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 19565
I20260812 00:30:57.485121 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 19782
Aug 12 00:30:57 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:30:57.501257 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:57.486002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42184 (local address 127.29.190.131:42925)
0812 00:30:57.486230 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:57.486239 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:57.486262 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:30:57.486514 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:57.486519 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:57.486586 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:57.486696 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:57.488123 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.488869 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.490175 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:57.490576 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:57.490722 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:57.495402 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:57.495419 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:57.495478 (+ 59us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:57.495530 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:57.498227 (+ 2697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:57.498931 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:57.498945 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:57.498947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:57.499096 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:57.499667 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:57.499673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:57.499676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:57.500044 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:57.500365 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:57.500693 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 00:30:57.500920 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:30:57.501961 19982 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:57.594830 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 19782
I20260812 00:30:57.624596 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 19183
I20260812 00:30:57.625809 19286 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:30:57.739984 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 19183
I20260812 00:30:57.771772 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36209
--webserver_interface=127.29.190.190
--webserver_port=45835
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:36209
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:30:58.142076 20077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:58.142381 20077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:58.142483 20077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:58.149853 20077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:30:58.149981 20077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:58.150028 20077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:58.150087 20077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:30:58.150132 20077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:30:58.160408 20077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:36209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=45835
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:58.161759 20077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:58.163059 20077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:58.191258 20091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:58.191305 20085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:58.191345 20086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:58.192607 20077 server_base.cc:1034] running on GCE node
I20260812 00:30:58.193650 20077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:58.195395 20077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:58.196714 20077 hybrid_clock.cc:648] HybridClock initialized: now 1786494658196650 us; error 48 us; skew 500 ppm
I20260812 00:30:58.197170 20077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:58 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494658, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:58.201610 20077 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:30:58.203565 20077 webserver.cc:460] Webserver started at http://127.29.190.190:45835/ using document root <none> and password file <none>
I20260812 00:30:58.204427 20077 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:58.204602 20077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:58.211025 20077 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 00:30:58.214344 20102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:58.215826 20077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:30:58.216027 20077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "f833f82c9395441b85d91a40a9a5051e"
format_stamp: "Formatted at 2026-08-12 00:30:54 on dist-test-slave-c12x"
server_key: "f19497bd0044111db103313ccd57eb77"
server_key_iv: "3340f308fb2df77f3ebbb3eaad0b8fc4"
server_key_version: "encryptionkey@0"
I20260812 00:30:58.217176 20077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:58.239245 20077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:58.243808 20077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:58.244129 20077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:58.264724 20077 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:36209
I20260812 00:30:58.264737 20185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:36209 every 8 connection(s)
I20260812 00:30:58.266348 20077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:30:58.269695 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 20077
I20260812 00:30:58.270776 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:39051
--local_ip_for_outbound_sockets=127.29.190.129
--tserver_master_addrs=127.29.190.190:36209
--webserver_port=37263
--webserver_interface=127.29.190.129
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:30:58.276391 20187 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:30:58.281906 20187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Bootstrap starting.
I20260812 00:30:58.303392 20187 log.cc:824] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:58.317539 20187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:30:58.318153 20187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Bootstrap complete.
I20260812 00:30:58.328114 20187 raft_consensus.cc:348] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:30:58.329016 20187 raft_consensus.cc:729] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f833f82c9395441b85d91a40a9a5051e, State: Initialized, Role: FOLLOWER
I20260812 00:30:58.329726 20187 consensus_queue.cc:260] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:30:58.329996 20187 raft_consensus.cc:388] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:30:58.330144 20187 raft_consensus.cc:482] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:30:58.330339 20187 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:30:58.334578 20187 raft_consensus.cc:504] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:30:58.335263 20187 leader_election.cc:302] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f833f82c9395441b85d91a40a9a5051e; no voters:
I20260812 00:30:58.335980 20187 leader_election.cc:288] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:30:58.336181 20195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:30:58.337599 20195 raft_consensus.cc:686] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 2 LEADER]: Becoming Leader. State: Replica: f833f82c9395441b85d91a40a9a5051e, State: Running, Role: LEADER
I20260812 00:30:58.338267 20195 consensus_queue.cc:237] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:30:58.338630 20187 sys_catalog.cc:564] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:30:58.341006 20197 sys_catalog.cc:455] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f833f82c9395441b85d91a40a9a5051e. Latest consensus state: current_term: 2 leader_uuid: "f833f82c9395441b85d91a40a9a5051e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } } }
I20260812 00:30:58.341512 20197 sys_catalog.cc:458] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:58.342129 20196 sys_catalog.cc:455] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f833f82c9395441b85d91a40a9a5051e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } } }
I20260812 00:30:58.342466 20196 sys_catalog.cc:458] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: This master's current role is: LEADER
I20260812 00:30:58.344704 20203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:30:58.357271 20203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:30:58.358990 20203 catalog_manager.cc:1259] Loaded cluster ID: f0205aca69294caea05f572db3516d6e
I20260812 00:30:58.359192 20203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:30:58.362543 20203 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 00:30:58.381347 20203 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 00:30:58.391032 20203 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:30:58.393241 20203 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Loaded TSK: 0
I20260812 00:30:58.394784 20203 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:30:58.654750 20192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:58.655104 20192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:58.655277 20192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:58.663060 20192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:58.663241 20192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:58.663424 20192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:30:58.674362 20192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:39051
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=37263
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:58.675876 20192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:58.677335 20192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:58.693485 20233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:58.693351 20232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:58.694207 20238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:58.694761 20192 server_base.cc:1034] running on GCE node
I20260812 00:30:58.695549 20192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:58.696687 20192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:58.697953 20192 hybrid_clock.cc:648] HybridClock initialized: now 1786494658697874 us; error 72 us; skew 500 ppm
I20260812 00:30:58.698333 20192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:58 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494658, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:58.701782 20192 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:30:58.703682 20192 webserver.cc:460] Webserver started at http://127.29.190.129:37263/ using document root <none> and password file <none>
I20260812 00:30:58.704459 20192 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:58.704628 20192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:58.710784 20192 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.006s
I20260812 00:30:58.714272 20250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:58.716069 20192 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:30:58.716295 20192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "220748cbd097442a8a5c62f42089bc07"
format_stamp: "Formatted at 2026-08-12 00:30:55 on dist-test-slave-c12x"
server_key: "66692490a5d9c2a21d287930d45dd8cb"
server_key_iv: "3f8549416716d55f56613da1519a2b2c"
server_key_version: "encryptionkey@0"
I20260812 00:30:58.717418 20192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:58.740914 20192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:58.745565 20192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:58.745914 20192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:58.747046 20192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:58.748544 20192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:58.748677 20192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:58.748821 20192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:58.748919 20192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:58.784173 20192 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:39051
I20260812 00:30:58.784269 20437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:39051 every 8 connection(s)
I20260812 00:30:58.785761 20192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:30:58.795889 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 20192
I20260812 00:30:58.796941 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:37085
--local_ip_for_outbound_sockets=127.29.190.130
--tserver_master_addrs=127.29.190.190:36209
--webserver_port=46097
--webserver_interface=127.29.190.130
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:30:58 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494658, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:58.813781 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:58.789157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:41677)
0812 00:30:58.790028 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:58.790075 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:58.791908 (+ 1833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:58.793241 (+ 1333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:58.793248 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:58.793794 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:58.794327 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:58.794345 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:58.796167 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:58.796175 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:58.798459 (+ 2284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:58.798482 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:58.799643 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:58.799654 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:58.800005 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:58.800864 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:58.800912 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:58.804206 (+ 3294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:58.808876 (+ 4670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:58.808887 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:58.808904 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:58.809660 (+ 756us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:58.810248 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:58.810252 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:58.810254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:58.810491 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:58.811554 (+ 1063us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:58.811561 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:58.811887 (+ 326us) client_negotiation.cc:769] Sending connection context
0812 00:30:58.812152 (+ 265us) client_negotiation.cc:240] Negotiation successful
0812 00:30:58.812618 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":379,"threads_started":1}
I20260812 00:30:58.814208 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:58.788926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:41677 (local address 127.29.190.190:36209)
0812 00:30:58.789607 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:58.789619 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:58.790210 (+ 591us) server_negotiation.cc:407] Connection header received
0812 00:30:58.792415 (+ 2205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:58.792428 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:58.792767 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:58.793087 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:58.794559 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:58.795853 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:58.798641 (+ 2788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:58.799318 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:58.799553 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:58.804595 (+ 5042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:58.804610 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:58.804635 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:58.804697 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:58.808683 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:58.809845 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:58.809858 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:58.809868 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:58.810106 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:58.810617 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:58.810626 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:58.810632 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:58.811373 (+ 741us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:58.811624 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:58.812447 (+ 823us) server_negotiation.cc:299] Negotiation successful
0812 00:30:58.812909 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":302,"threads_started":1}
I20260812 00:30:58.817198 20438 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36209
I20260812 00:30:58.817541 20438 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:58.818486 20438 heartbeater.cc:511] Master 127.29.190.190:36209 requested a full tablet report, sending...
I20260812 00:30:58.821143 20129 ts_manager.cc:194] Registered new tserver with Master: 220748cbd097442a8a5c62f42089bc07 (127.29.190.129:39051)
I20260812 00:30:58.822772 20129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:41677
W20260812 00:30:59.152756 20444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:59.153026 20444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:59.153200 20444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:59.160390 20444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:59.160499 20444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:59.160698 20444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:30:59.170429 20444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:37085
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=46097
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:59.171777 20444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:59.173168 20444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:59.186726 20458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:59.186757 20454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:59.186967 20453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:59.188457 20444 server_base.cc:1034] running on GCE node
I20260812 00:30:59.189116 20444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:59.190179 20444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:59.191411 20444 hybrid_clock.cc:648] HybridClock initialized: now 1786494659191373 us; error 55 us; skew 500 ppm
I20260812 00:30:59.191792 20444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:59 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494659, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:59.195145 20444 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:30:59.196762 20444 webserver.cc:460] Webserver started at http://127.29.190.130:46097/ using document root <none> and password file <none>
I20260812 00:30:59.197482 20444 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:59.197656 20444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:59.203325 20444 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:30:59.206198 20467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:59.207768 20444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:30:59.207967 20444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "e67e2a01a0ac41348009e046c93915ab"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "f2c4e0f1e5885909eaf28eef3f86c6da"
server_key_iv: "432e18156d6380b3d671e82235b72c96"
server_key_version: "encryptionkey@0"
I20260812 00:30:59.208973 20444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:59.229063 20444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:59.233614 20444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:59.233927 20444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:59.235008 20444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:59.236790 20444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:59.236927 20444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:59.237068 20444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:59.237161 20444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:59.273769 20444 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:37085
I20260812 00:30:59.273816 20659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:37085 every 8 connection(s)
I20260812 00:30:59.275293 20444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:30:59.281805 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 20444
I20260812 00:30:59.282532 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:42925
--local_ip_for_outbound_sockets=127.29.190.131
--tserver_master_addrs=127.29.190.190:36209
--webserver_port=42417
--webserver_interface=127.29.190.131
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:30:59 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494659, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:59.296339 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.278192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:47005 (local address 127.29.190.190:36209)
0812 00:30:59.278376 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:59.278381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:59.279856 (+ 1475us) server_negotiation.cc:407] Connection header received
0812 00:30:59.281687 (+ 1831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:59.281692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:59.281825 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:59.281952 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:59.283686 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.284397 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.285966 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.286396 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.286549 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.290368 (+ 3819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:59.290373 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:59.290377 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:59.290410 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:59.293154 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:59.293929 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:59.293936 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:59.293944 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:59.294068 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:59.294535 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:59.294539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:59.294541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:59.294803 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:59.294978 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:59.295746 (+ 768us) server_negotiation.cc:299] Negotiation successful
0812 00:30:59.295985 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 00:30:59.297379 20664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.278805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:47005)
0812 00:30:59.279699 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:59.279737 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:59.281419 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:59.282245 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:59.282253 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:59.282876 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:59.283504 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.283538 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.284564 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.284569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.285809 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.285821 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.286633 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.286642 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.286894 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.287709 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:59.287732 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:59.290140 (+ 2408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:59.293325 (+ 3185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:59.293334 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:59.293353 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:59.293791 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:59.294187 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:59.294192 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:59.294196 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:59.294394 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:59.294942 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:59.294950 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:59.295314 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 00:30:59.295640 (+ 326us) client_negotiation.cc:240] Negotiation successful
0812 00:30:59.296219 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":343,"threads_started":1}
I20260812 00:30:59.298982 20660 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36209
I20260812 00:30:59.299315 20660 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:59.300169 20660 heartbeater.cc:511] Master 127.29.190.190:36209 requested a full tablet report, sending...
I20260812 00:30:59.301718 20129 ts_manager.cc:194] Registered new tserver with Master: e67e2a01a0ac41348009e046c93915ab (127.29.190.130:37085)
I20260812 00:30:59.302568 20129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:47005
W20260812 00:30:59.642781 20665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:30:59.643138 20665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:30:59.643328 20665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:30:59.651252 20665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:30:59.651474 20665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:30:59.651670 20665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:30:59.662416 20665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:42925
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=42417
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:30:59.663913 20665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:30:59.665405 20665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:30:59.679565 20671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:59.679566 20673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:30:59.679600 20670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:30:59.680536 20665 server_base.cc:1034] running on GCE node
I20260812 00:30:59.681165 20665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:30:59.682103 20665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:30:59.683341 20665 hybrid_clock.cc:648] HybridClock initialized: now 1786494659683293 us; error 55 us; skew 500 ppm
I20260812 00:30:59.683712 20665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:30:59 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494659, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:30:59.686861 20665 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:30:59.688536 20665 webserver.cc:460] Webserver started at http://127.29.190.131:42417/ using document root <none> and password file <none>
I20260812 00:30:59.689267 20665 fs_manager.cc:359] Metadata directory not provided
I20260812 00:30:59.689435 20665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:30:59.694826 20665 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 00:30:59.697607 20686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:59.699047 20665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:30:59.699267 20665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "309743121dea4633862118b72eea8b64"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "299123ead716aa2dcef4b8c19f6ab5da"
server_key_iv: "2762b5f8114e6310e8fdfc34b608f0fb"
server_key_version: "encryptionkey@0"
I20260812 00:30:59.700453 20665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:30:59.715620 20665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:30:59.719974 20665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:30:59.720271 20665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:30:59.721375 20665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:30:59.722926 20665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:30:59.723052 20665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:59.723186 20665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:30:59.723282 20665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:30:59.758736 20665 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:42925
I20260812 00:30:59.758832 20872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:42925 every 8 connection(s)
I20260812 00:30:59.760306 20665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:30:59.767282 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 20665
Aug 12 00:30:59 dist-test-slave-c12x krb5kdc[19161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494659, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:30:59.782874 20440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.762960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:38483 (local address 127.29.190.190:36209)
0812 00:30:59.763149 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:59.763154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:59.764324 (+ 1170us) server_negotiation.cc:407] Connection header received
0812 00:30:59.766149 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:59.766155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:59.766248 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:59.766364 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:59.768379 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.769519 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.771164 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.771715 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.771814 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.775944 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:59.775953 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:59.775959 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:59.776004 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:59.779274 (+ 3270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:59.780376 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:59.780381 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:59.780383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:59.780537 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:59.781085 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:59.781088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:59.781091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:59.781382 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:59.781586 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:59.782299 (+ 713us) server_negotiation.cc:299] Negotiation successful
0812 00:30:59.782528 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":65}
I20260812 00:30:59.784276 20883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.763401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:38483)
0812 00:30:59.764159 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:59.764198 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:59.765869 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:59.766603 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:59.766611 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:59.767357 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:30:59.768184 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.768213 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.769710 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.769714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.771002 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.771017 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.771937 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.771944 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.772253 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.772971 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:30:59.772994 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:30:59.775721 (+ 2727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:30:59.779474 (+ 3753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:59.779488 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:59.779510 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:59.780232 (+ 722us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:59.780665 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:30:59.780671 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:30:59.780676 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:30:59.780953 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:30:59.781561 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:30:59.781569 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:30:59.781913 (+ 344us) client_negotiation.cc:769] Sending connection context
0812 00:30:59.782194 (+ 281us) client_negotiation.cc:240] Negotiation successful
0812 00:30:59.782730 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":275,"threads_started":1}
I20260812 00:30:59.784678 20890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.768375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42888 (local address 127.29.190.190:36209)
0812 00:30:59.769210 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:59.769215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:59.769232 (+ 17us) server_negotiation.cc:407] Connection header received
0812 00:30:59.769273 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:59.769276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:59.769345 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:59.769439 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:30:59.771006 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.772028 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.773440 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.774118 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.774271 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.777746 (+ 3475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:30:59.777757 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:30:59.777764 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:30:59.777824 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:30:59.781549 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:59.782388 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:59.782395 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:59.782399 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:59.782538 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:30:59.782990 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:30:59.782996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:30:59.782999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:30:59.783313 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:30:59.783626 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:59.784022 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 00:30:59.784251 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":735,"thread_start_us":614,"threads_started":1}
I20260812 00:30:59.786479 20874 heartbeater.cc:347] Connected to a master server at 127.29.190.190:36209
I20260812 00:30:59.786862 20874 heartbeater.cc:464] Registering TS with master...
I20260812 00:30:59.787837 20874 heartbeater.cc:511] Master 127.29.190.190:36209 requested a full tablet report, sending...
I20260812 00:30:59.789477 20129 ts_manager.cc:194] Registered new tserver with Master: 309743121dea4633862118b72eea8b64 (127.29.190.131:42925)
I20260812 00:30:59.790771 20129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:38483
I20260812 00:30:59.800608 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:30:59.808200 20890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.801566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42892 (local address 127.29.190.190:36209)
0812 00:30:59.801830 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:59.801839 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:59.802194 (+ 355us) server_negotiation.cc:407] Connection header received
0812 00:30:59.802492 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:59.802496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:59.802653 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:59.802819 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:30:59.803301 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.804110 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.805711 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.806287 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.806428 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.806958 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:30:59.807573 (+ 615us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:30:59.807731 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:59.807835 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 00:30:59.807928 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:30:59.809157 20129 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:42892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:30:59.817109 20129 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:30:59.826854 20438 heartbeater.cc:503] Master 127.29.190.190:36209 was elected leader, sending a full tablet report...
I20260812 00:30:59.843554 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.830793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:37085 (local address 127.0.0.1:35966)
0812 00:30:59.832251 (+ 1458us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:59.832297 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:59.832491 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:59.833743 (+ 1252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:59.833756 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:59.833789 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:59.834262 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.834277 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.836820 (+ 2543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.836830 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.839744 (+ 2914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.839771 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.842383 (+ 2612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.842391 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.842590 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.842654 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 00:30:59.842768 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:30:59.843005 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1189,"threads_started":1}
I20260812 00:30:59.849018 20900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.831913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35966 (local address 127.29.190.130:37085)
0812 00:30:59.832588 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:59.832602 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:59.832650 (+ 48us) server_negotiation.cc:407] Connection header received
0812 00:30:59.832789 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:59.832801 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:59.833133 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:59.833392 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:59.834480 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.836591 (+ 2111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.840076 (+ 3485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.842135 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.847882 (+ 5747us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.848188 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:59.848291 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 00:30:59.848557 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":817,"threads_started":1}
I20260812 00:30:59.853345 20548 tablet_service.cc:1467] Processing CreateTablet for tablet af8d6b3630d84e50826337539fba2f0e (DEFAULT_TABLE table=test-table [id=0b48f80cc4fa4bcc97d98d4ff8584cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:59.854871 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.831406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47634)
0812 00:30:59.844338 (+ 12932us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:59.844365 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:59.844506 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:59.845853 (+ 1347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:59.845862 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:59.845936 (+ 74us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:59.846216 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.846231 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.848248 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.848255 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.850743 (+ 2488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.850758 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.853994 (+ 3236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.853999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.854192 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.854238 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 00:30:59.854326 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 00:30:59.854480 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12753,"mutex_wait_us":31,"spinlock_wait_cycles":32768,"thread_start_us":1490,"threads_started":1}
I20260812 00:30:59.855041 20548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af8d6b3630d84e50826337539fba2f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:59.856001 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.833780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:42925 (local address 127.0.0.1:42190)
0812 00:30:59.845733 (+ 11953us) negotiation.cc:107] Waiting for socket to connect
0812 00:30:59.845758 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:30:59.845933 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:30:59.850378 (+ 4445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:30:59.850383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:30:59.850415 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:30:59.850844 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.850855 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.852333 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.852340 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.853647 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:30:59.853660 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.855097 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.855104 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:30:59.855289 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.855337 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 00:30:59.855458 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 00:30:59.855602 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11771,"mutex_wait_us":1,"spinlock_wait_cycles":5888,"thread_start_us":13741,"threads_started":1}
I20260812 00:30:59.856065 20901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.832538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47634 (local address 127.29.190.129:39051)
0812 00:30:59.833182 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:59.833190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:59.844687 (+ 11497us) server_negotiation.cc:407] Connection header received
0812 00:30:59.844841 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:59.844854 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:59.845262 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:59.845524 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:59.846468 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.848104 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.850953 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.852426 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.852642 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.855417 (+ 2775us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:59.855531 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 00:30:59.855706 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":1380,"threads_started":1}
I20260812 00:30:59.856086 20903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:30:59.834558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42190 (local address 127.29.190.131:42925)
0812 00:30:59.849852 (+ 15294us) server_negotiation.cc:206] Beginning negotiation
0812 00:30:59.849858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:30:59.849890 (+ 32us) server_negotiation.cc:407] Connection header received
0812 00:30:59.849970 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:30:59.849975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:30:59.850171 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:30:59.850391 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:30:59.851057 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.852189 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.853832 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:30:59.854865 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:30:59.855097 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:30:59.855276 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 00:30:59.855567 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 00:30:59.855741 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15114,"thread_start_us":14953,"threads_started":1}
I20260812 00:30:59.859647 20775 tablet_service.cc:1467] Processing CreateTablet for tablet af8d6b3630d84e50826337539fba2f0e (DEFAULT_TABLE table=test-table [id=0b48f80cc4fa4bcc97d98d4ff8584cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:59.860026 20326 tablet_service.cc:1467] Processing CreateTablet for tablet af8d6b3630d84e50826337539fba2f0e (DEFAULT_TABLE table=test-table [id=0b48f80cc4fa4bcc97d98d4ff8584cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:30:59.861172 20775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af8d6b3630d84e50826337539fba2f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:59.861452 20326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af8d6b3630d84e50826337539fba2f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:30:59.872035 20907 tablet_bootstrap.cc:492] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Bootstrap starting.
I20260812 00:30:59.874179 20908 tablet_bootstrap.cc:492] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Bootstrap starting.
I20260812 00:30:59.877051 20907 tablet_bootstrap.cc:654] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:59.877296 20910 tablet_bootstrap.cc:492] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Bootstrap starting.
I20260812 00:30:59.877863 20908 tablet_bootstrap.cc:654] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:59.878636 20907 log.cc:824] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:59.878922 20908 log.cc:824] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:59.881338 20910 tablet_bootstrap.cc:654] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Neither blocks nor log segments found. Creating new log.
I20260812 00:30:59.882227 20907 tablet_bootstrap.cc:492] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: No bootstrap required, opened a new log
I20260812 00:30:59.882529 20907 ts_tablet_manager.cc:1397] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260812 00:30:59.882624 20910 log.cc:824] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Log is configured to *not* fsync() on all Append() calls
I20260812 00:30:59.885238 20908 tablet_bootstrap.cc:492] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: No bootstrap required, opened a new log
I20260812 00:30:59.885545 20908 ts_tablet_manager.cc:1397] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260812 00:30:59.885800 20910 tablet_bootstrap.cc:492] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: No bootstrap required, opened a new log
I20260812 00:30:59.886075 20910 ts_tablet_manager.cc:1397] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260812 00:30:59.893414 20908 raft_consensus.cc:348] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:30:59.894007 20908 raft_consensus.cc:374] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:59.893778 20907 raft_consensus.cc:348] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:30:59.894148 20908 raft_consensus.cc:729] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 309743121dea4633862118b72eea8b64, State: Initialized, Role: FOLLOWER
I20260812 00:30:59.894309 20907 raft_consensus.cc:374] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:59.894601 20907 raft_consensus.cc:729] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e67e2a01a0ac41348009e046c93915ab, State: Initialized, Role: FOLLOWER
I20260812 00:30:59.895005 20908 consensus_queue.cc:260] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:30:59.895356 20907 consensus_queue.cc:260] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:30:59.896451 20874 heartbeater.cc:503] Master 127.29.190.190:36209 was elected leader, sending a full tablet report...
I20260812 00:30:59.896907 20660 heartbeater.cc:503] Master 127.29.190.190:36209 was elected leader, sending a full tablet report...
I20260812 00:30:59.897285 20908 ts_tablet_manager.cc:1428] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Time spent starting tablet: real 0.012s user 0.004s sys 0.008s
I20260812 00:30:59.897315 20910 raft_consensus.cc:348] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:30:59.897748 20910 raft_consensus.cc:374] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:30:59.897850 20910 raft_consensus.cc:729] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220748cbd097442a8a5c62f42089bc07, State: Initialized, Role: FOLLOWER
I20260812 00:30:59.898633 20910 consensus_queue.cc:260] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:30:59.899997 20907 ts_tablet_manager.cc:1428] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260812 00:30:59.901198 20910 ts_tablet_manager.cc:1428] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
W20260812 00:31:00.012109 20882 tablet.cc:2369] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:31:00.027752 20662 tablet.cc:2369] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:31:00.038475 20439 tablet.cc:2369] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:31:00.091833 20914 raft_consensus.cc:482] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:31:00.092227 20914 raft_consensus.cc:504] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:31:00.094126 20914 leader_election.cc:288] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e67e2a01a0ac41348009e046c93915ab (127.29.190.130:37085), 220748cbd097442a8a5c62f42089bc07 (127.29.190.129:39051)
I20260812 00:31:00.100682 20883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.094335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:37085 (local address 127.29.190.131:46537)
0812 00:31:00.094739 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.094761 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:00.094930 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:00.095486 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:00.095490 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:00.095520 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:00.095732 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:00.095745 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.096992 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.096997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:00.098516 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:00.098528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.099877 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.099883 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:00.100084 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:00.100119 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:31:00.100224 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 00:31:00.100358 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":24}
I20260812 00:31:00.100714 20900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.094618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:46537 (local address 127.29.190.130:37085)
0812 00:31:00.094856 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:00.094866 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:00.094897 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:31:00.095181 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:00.095187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:00.095272 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:00.095385 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:00.095899 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.096846 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.098677 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.099720 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.099839 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:00.099892 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:00.100291 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 00:31:00.100394 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:31:00.101305 20901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.094715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:33811 (local address 127.29.190.129:39051)
0812 00:31:00.095122 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:00.095129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:00.095407 (+ 278us) server_negotiation.cc:407] Connection header received
0812 00:31:00.095631 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:00.095636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:00.095714 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:00.095825 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:00.096431 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.097314 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.099317 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.100351 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.100499 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:00.100577 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:00.100992 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 00:31:00.101134 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228}
I20260812 00:31:00.101920 20917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.094489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.29.190.131:33811)
0812 00:31:00.095293 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.095312 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:00.095467 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:00.095876 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:00.095881 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:00.095907 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:00.096268 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:00.096280 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.097499 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.097503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:00.099148 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:00.099162 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.100590 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.100597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:00.100782 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:00.100821 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:31:00.101529 (+ 708us) client_negotiation.cc:240] Negotiation successful
0812 00:31:00.101640 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":23,"thread_start_us":383,"threads_started":1}
I20260812 00:31:00.101802 20583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af8d6b3630d84e50826337539fba2f0e" candidate_uuid: "309743121dea4633862118b72eea8b64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e67e2a01a0ac41348009e046c93915ab" is_pre_election: true
I20260812 00:31:00.102335 20583 raft_consensus.cc:2454] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 309743121dea4633862118b72eea8b64 in term 0.
I20260812 00:31:00.102874 20356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af8d6b3630d84e50826337539fba2f0e" candidate_uuid: "309743121dea4633862118b72eea8b64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220748cbd097442a8a5c62f42089bc07" is_pre_election: true
I20260812 00:31:00.103020 20692 leader_election.cc:302] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 309743121dea4633862118b72eea8b64, e67e2a01a0ac41348009e046c93915ab; no voters:
I20260812 00:31:00.103415 20356 raft_consensus.cc:2454] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 309743121dea4633862118b72eea8b64 in term 0.
I20260812 00:31:00.103498 20914 raft_consensus.cc:2781] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:31:00.103652 20914 raft_consensus.cc:482] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:31:00.103767 20914 raft_consensus.cc:3037] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:00.106428 20914 raft_consensus.cc:504] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:31:00.107123 20914 leader_election.cc:288] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [CANDIDATE]: Term 1 election: Requested vote from peers e67e2a01a0ac41348009e046c93915ab (127.29.190.130:37085), 220748cbd097442a8a5c62f42089bc07 (127.29.190.129:39051)
I20260812 00:31:00.107599 20583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af8d6b3630d84e50826337539fba2f0e" candidate_uuid: "309743121dea4633862118b72eea8b64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e67e2a01a0ac41348009e046c93915ab"
I20260812 00:31:00.107645 20356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af8d6b3630d84e50826337539fba2f0e" candidate_uuid: "309743121dea4633862118b72eea8b64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "220748cbd097442a8a5c62f42089bc07"
I20260812 00:31:00.107841 20356 raft_consensus.cc:3037] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:00.107841 20583 raft_consensus.cc:3037] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:00.111243 20583 raft_consensus.cc:2454] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 309743121dea4633862118b72eea8b64 in term 1.
I20260812 00:31:00.111243 20356 raft_consensus.cc:2454] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 309743121dea4633862118b72eea8b64 in term 1.
I20260812 00:31:00.111726 20693 leader_election.cc:302] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 220748cbd097442a8a5c62f42089bc07, 309743121dea4633862118b72eea8b64; no voters:
I20260812 00:31:00.112087 20914 raft_consensus.cc:2781] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:31:00.112646 20914 raft_consensus.cc:686] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 1 LEADER]: Becoming Leader. State: Replica: 309743121dea4633862118b72eea8b64, State: Running, Role: LEADER
I20260812 00:31:00.113183 20914 consensus_queue.cc:237] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } }
I20260812 00:31:00.118557 20128 catalog_manager.cc:5495] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 309743121dea4633862118b72eea8b64 (127.29.190.131). New cstate: current_term: 1 leader_uuid: "309743121dea4633862118b72eea8b64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "309743121dea4633862118b72eea8b64" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 42925 } health_report { overall_health: HEALTHY } } }
I20260812 00:31:00.138835 20903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.133177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42192 (local address 127.29.190.131:42925)
0812 00:31:00.133425 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:00.133432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:00.133452 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:31:00.133729 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:00.133733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:00.133814 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:00.133987 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:31:00.134368 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.135134 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.136632 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.137055 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.137196 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:00.137723 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:31:00.138247 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:31:00.138411 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:00.138485 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 00:31:00.138565 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:31:00.147260 20583 raft_consensus.cc:1261] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 1 FOLLOWER]: Refusing update from remote peer 309743121dea4633862118b72eea8b64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:31:00.147259 20356 raft_consensus.cc:1261] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 1 FOLLOWER]: Refusing update from remote peer 309743121dea4633862118b72eea8b64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:31:00.148401 20919 consensus_queue.cc:1035] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e67e2a01a0ac41348009e046c93915ab" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:31:00.148782 20914 consensus_queue.cc:1035] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "220748cbd097442a8a5c62f42089bc07" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 39051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:31:00.159567 20922 mvcc.cc:205] Tried to move back new op lower bound from 7317482127952908288 to 7317482127827845120. Current Snapshot: MvccSnapshot[applied={T|T < 7317482127952908288}]
I20260812 00:31:00.180177 20128 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:42892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:31:00.180467 20128 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:42892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:31:00.183974 20128 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Sending DeleteTablet for 3 replicas of tablet af8d6b3630d84e50826337539fba2f0e
I20260812 00:31:00.185204 20548 tablet_service.cc:1514] Processing DeleteTablet for tablet af8d6b3630d84e50826337539fba2f0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:00 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:35966
I20260812 00:31:00.185562 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 20192
I20260812 00:31:00.185657 20326 tablet_service.cc:1514] Processing DeleteTablet for tablet af8d6b3630d84e50826337539fba2f0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:00 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:47634
I20260812 00:31:00.186731 20775 tablet_service.cc:1514] Processing DeleteTablet for tablet af8d6b3630d84e50826337539fba2f0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:00 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:42190
I20260812 00:31:00.196544 20943 tablet_replica.cc:330] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: stopping tablet replica
I20260812 00:31:00.196707 20940 tablet_replica.cc:330] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: stopping tablet replica
I20260812 00:31:00.197266 20940 raft_consensus.cc:2229] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:31:00.197324 20943 raft_consensus.cc:2229] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:31:00.197881 20940 raft_consensus.cc:2258] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:00.198333 20943 raft_consensus.cc:2258] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:00.200852 20943 ts_tablet_manager.cc:1905] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:00.207615 20940 ts_tablet_manager.cc:1905] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:00.208870 20943 ts_tablet_manager.cc:1918] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:00.209121 20943 log.cc:1196] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/af8d6b3630d84e50826337539fba2f0e
I20260812 00:31:00.209730 20943 ts_tablet_manager.cc:1939] T af8d6b3630d84e50826337539fba2f0e P 309743121dea4633862118b72eea8b64: Deleting consensus metadata
I20260812 00:31:00.211377 20941 tablet_replica.cc:330] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: stopping tablet replica
I20260812 00:31:00.211740 20111 catalog_manager.cc:4841] TS 309743121dea4633862118b72eea8b64 (127.29.190.131:42925): tablet af8d6b3630d84e50826337539fba2f0e (table test-table [id=0b48f80cc4fa4bcc97d98d4ff8584cbf]) successfully deleted
I20260812 00:31:00.211903 20941 raft_consensus.cc:2229] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:31:00.212422 20941 raft_consensus.cc:2258] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:00.214776 20941 ts_tablet_manager.cc:1905] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:00.215085 20940 ts_tablet_manager.cc:1918] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:00.215265 20940 log.cc:1196] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/af8d6b3630d84e50826337539fba2f0e
I20260812 00:31:00.215811 20940 ts_tablet_manager.cc:1939] T af8d6b3630d84e50826337539fba2f0e P e67e2a01a0ac41348009e046c93915ab: Deleting consensus metadata
I20260812 00:31:00.217459 20110 catalog_manager.cc:4841] TS e67e2a01a0ac41348009e046c93915ab (127.29.190.130:37085): tablet af8d6b3630d84e50826337539fba2f0e (table test-table [id=0b48f80cc4fa4bcc97d98d4ff8584cbf]) successfully deleted
I20260812 00:31:00.220913 20901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.187600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47642 (local address 127.29.190.129:39051)
0812 00:31:00.187829 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:00.187838 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:00.187862 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:31:00.187939 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:00.187947 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:00.188047 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:00.188179 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:00.190792 (+ 2613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.192359 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.195051 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.195923 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.196066 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:00.201237 (+ 5171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:00.201259 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:00.201276 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:00.201323 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:00.217437 (+ 16114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:00.218376 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:00.218394 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:00.218396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:00.218566 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:00.218989 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:00.218994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:00.218999 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:00.219403 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:00.219833 (+ 430us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:00.220159 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 00:31:00.220415 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:31:00.221748 20428 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:00.326926 20941 ts_tablet_manager.cc:1918] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:00.327343 20941 log.cc:1196] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/af8d6b3630d84e50826337539fba2f0e
I20260812 00:31:00.327818 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 20192
W20260812 00:31:00.354506 20111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.190.129:39051 (error 108)
I20260812 00:31:00.354808 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 20444
I20260812 00:31:00.356590 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.356096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47646)
0812 00:31:00.356286 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.356409 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260812 00:31:00.356891 20111 catalog_manager.cc:4584] TS 220748cbd097442a8a5c62f42089bc07 (127.29.190.129:39051): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet af8d6b3630d84e50826337539fba2f0e: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
I20260812 00:31:00.371981 20900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.355793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35972 (local address 127.29.190.130:37085)
0812 00:31:00.356023 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:00.356032 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:00.356054 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:31:00.356152 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:00.356160 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:00.356256 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:00.356369 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:00.358228 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.358991 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.361035 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.361435 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.361530 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:00.365100 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:00.365115 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:00.365132 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:00.365169 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:00.368955 (+ 3786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:00.369710 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:00.369720 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:00.369724 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:00.369881 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:00.370265 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:00.370270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:00.370274 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:00.370763 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:00.371058 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:00.371318 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 00:31:00.371593 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 00:31:00.372809 20652 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:00.410697 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.410028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47650)
0812 00:31:00.410306 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.410440 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260812 00:31:00.412026 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.411586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47658)
0812 00:31:00.411776 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.411873 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 00:31:00.465780 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 20444
I20260812 00:31:00.476624 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.475938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47662)
0812 00:31:00.476230 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.476359 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 00:31:00.478029 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.477530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47672)
0812 00:31:00.477739 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.477860 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 00:31:00.497049 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 20665
I20260812 00:31:00.516041 20903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.498099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42196 (local address 127.29.190.131:42925)
0812 00:31:00.498286 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:00.498290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:00.498311 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:31:00.498508 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:00.498513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:00.498589 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:00.498684 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:00.500866 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.501715 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.503980 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:00.504682 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:00.504836 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:00.508759 (+ 3923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:00.508772 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:00.508789 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:00.508844 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:00.512497 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:00.513581 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:00.513588 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:00.513591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:00.513749 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:00.514278 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:00.514283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:00.514289 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:00.514699 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:00.514978 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:00.515411 (+ 433us) server_negotiation.cc:299] Negotiation successful
0812 00:31:00.515671 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:31:00.516842 20867 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:00.558964 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.558435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47682)
0812 00:31:00.558657 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.558757 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 00:31:00.560197 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.559765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47684)
0812 00:31:00.559989 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.560077 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260812 00:31:00.646486 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 20665
I20260812 00:31:00.673787 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 20077
I20260812 00:31:00.675102 20180 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:00.788362 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 20077
I20260812 00:31:00.788383 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:00.787667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:39051 (local address 127.0.0.1:47696)
0812 00:31:00.787891 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:00.788087 (+ 196us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:39051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 00:31:00.820132 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36209
--webserver_interface=127.29.190.190
--webserver_port=45835
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:36209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:31:01.177651 20954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:01.177955 20954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:01.178128 20954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:01.185397 20954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:31:01.185527 20954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:01.185632 20954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:01.185753 20954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:31:01.185839 20954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:31:01.196010 20954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:36209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:36209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=45835
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:01.197512 20954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:01.198874 20954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:01.211359 20966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:01.211400 20962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:01.211462 20961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:01.217336 20954 server_base.cc:1034] running on GCE node
I20260812 00:31:01.218274 20954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:01.220274 20954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:01.221503 20954 hybrid_clock.cc:648] HybridClock initialized: now 1786494661221430 us; error 57 us; skew 500 ppm
I20260812 00:31:01.221876 20954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:01 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494661, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:01.225178 20954 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:31:01.226820 20954 webserver.cc:460] Webserver started at http://127.29.190.190:45835/ using document root <none> and password file <none>
I20260812 00:31:01.227581 20954 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:01.227694 20954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:01.233268 20954 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:31:01.236359 20979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:01.237843 20954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:31:01.238058 20954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "f833f82c9395441b85d91a40a9a5051e"
format_stamp: "Formatted at 2026-08-12 00:30:54 on dist-test-slave-c12x"
server_key: "f19497bd0044111db103313ccd57eb77"
server_key_iv: "3340f308fb2df77f3ebbb3eaad0b8fc4"
server_key_version: "encryptionkey@0"
I20260812 00:31:01.239109 20954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:01.280047 20954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:01.284473 20954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:01.284788 20954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:01.305640 20954 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:36209
I20260812 00:31:01.305683 21060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:36209 every 8 connection(s)
I20260812 00:31:01.307301 20954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:31:01.310072 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 20954
I20260812 00:31:01.311143 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:39051
--local_ip_for_outbound_sockets=127.29.190.129
--tserver_master_addrs=127.29.190.190:36209
--webserver_port=37263
--webserver_interface=127.29.190.129
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:31:01.317516 21061 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:31:01.323071 21061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Bootstrap starting.
I20260812 00:31:01.345851 21061 log.cc:824] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:01.365121 21061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:31:01.365783 21061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e: Bootstrap complete.
I20260812 00:31:01.375514 21061 raft_consensus.cc:348] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:31:01.376639 21061 raft_consensus.cc:729] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f833f82c9395441b85d91a40a9a5051e, State: Initialized, Role: FOLLOWER
I20260812 00:31:01.377372 21061 consensus_queue.cc:260] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:31:01.377658 21061 raft_consensus.cc:388] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:31:01.377804 21061 raft_consensus.cc:482] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:31:01.377998 21061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:31:01.382184 21061 raft_consensus.cc:504] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:31:01.382781 21061 leader_election.cc:302] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f833f82c9395441b85d91a40a9a5051e; no voters:
I20260812 00:31:01.383563 21061 leader_election.cc:288] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:31:01.383760 21065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:31:01.386328 21065 raft_consensus.cc:686] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [term 3 LEADER]: Becoming Leader. State: Replica: f833f82c9395441b85d91a40a9a5051e, State: Running, Role: LEADER
I20260812 00:31:01.387085 21065 consensus_queue.cc:237] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } }
I20260812 00:31:01.387825 21061 sys_catalog.cc:564] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:31:01.389967 21067 sys_catalog.cc:455] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f833f82c9395441b85d91a40a9a5051e. Latest consensus state: current_term: 3 leader_uuid: "f833f82c9395441b85d91a40a9a5051e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } } }
I20260812 00:31:01.390959 21067 sys_catalog.cc:458] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: This master's current role is: LEADER
I20260812 00:31:01.390652 21066 sys_catalog.cc:455] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f833f82c9395441b85d91a40a9a5051e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f833f82c9395441b85d91a40a9a5051e" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 36209 } } }
I20260812 00:31:01.391603 21066 sys_catalog.cc:458] T 00000000000000000000000000000000 P f833f82c9395441b85d91a40a9a5051e [sys.catalog]: This master's current role is: LEADER
I20260812 00:31:01.394187 21073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:31:01.403551 21073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:31:01.405356 21073 catalog_manager.cc:1259] Loaded cluster ID: f0205aca69294caea05f572db3516d6e
I20260812 00:31:01.405547 21073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 00:31:01.407907 21073 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f52c51d59ad google::LogMessage::Fail() at ??:0
@ 0x7f52c51d888a google::LogMessage::SendToLog() at ??:0
@ 0x7f52c51d54de google::LogMessage::Flush() at ??:0
@ 0x7f52c51d6a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f52dac0c512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f52dac09976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f52dac91610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f52dac91439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f52c7e21345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f52c7e2491c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f52c7e24799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f52c7dffeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f52cb0d96db start_thread at ??:0
@ 0x7f52c406f61f clone at ??:0
W20260812 00:31:01.717880 21063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:01.718189 21063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:01.718297 21063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:01.725771 21063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:01.725904 21063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:01.726023 21063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:31:01.736305 21063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:39051
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=37263
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:01.737675 21063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:01.739092 21063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:01.754035 21127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:01.754115 21126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:01.754067 21130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:01.760214 21063 server_base.cc:1034] running on GCE node
I20260812 00:31:01.761111 21063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:01.762265 21063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:01.763535 21063 hybrid_clock.cc:648] HybridClock initialized: now 1786494661763445 us; error 64 us; skew 500 ppm
I20260812 00:31:01.763878 21063 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:01 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494661, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:01.767275 21063 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:31:01.769006 21063 webserver.cc:460] Webserver started at http://127.29.190.129:37263/ using document root <none> and password file <none>
I20260812 00:31:01.769809 21063 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:01.769968 21063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:01.775744 21063 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:31:01.778613 21142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:01.780121 21063 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:31:01.780316 21063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "220748cbd097442a8a5c62f42089bc07"
format_stamp: "Formatted at 2026-08-12 00:30:55 on dist-test-slave-c12x"
server_key: "66692490a5d9c2a21d287930d45dd8cb"
server_key_iv: "3f8549416716d55f56613da1519a2b2c"
server_key_version: "encryptionkey@0"
I20260812 00:31:01.781373 21063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:01.804932 21063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:01.809250 21063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:01.809558 21063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:01.810663 21063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:01.812673 21152 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260812 00:31:01.818511 21152 ts_tablet_manager.cc:1852] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260812 00:31:01.819598 21152 ts_tablet_manager.cc:1905] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:01.827165 21152 ts_tablet_manager.cc:1918] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:01.827566 21152 ts_tablet_manager.cc:1939] T af8d6b3630d84e50826337539fba2f0e P 220748cbd097442a8a5c62f42089bc07: Deleting consensus metadata
I20260812 00:31:01.828174 21063 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260812 00:31:01.828315 21063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.016s user 0.001s sys 0.000s
I20260812 00:31:01.828431 21063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:01.828491 21063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:01.865578 21063 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:39051
I20260812 00:31:01.865677 21312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:39051 every 8 connection(s)
I20260812 00:31:01.867049 21063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:31:01.872453 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:01.870309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:50401)
0812 00:31:01.871136 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:01.871393 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":335,"threads_started":1}
W20260812 00:31:01.873122 21314 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:36209 (0 consecutive failures): Network error: Failed to ping master at 127.29.190.190:36209: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
I20260812 00:31:01.874046 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:01.873689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:47069)
0812 00:31:01.873859 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:01.873940 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 00:31:01.874943 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:01.874593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:37839)
0812 00:31:01.874741 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:01.874823 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 00:31:01.875185 21314 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:31:01.876047 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 21063
I20260812 00:31:01.876756 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:37085
--local_ip_for_outbound_sockets=127.29.190.130
--tserver_master_addrs=127.29.190.190:36209
--webserver_port=46097
--webserver_interface=127.29.190.130
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:31:02.231127 21318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:02.231410 21318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:02.231631 21318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:02.239310 21318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:02.239477 21318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:02.239689 21318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:31:02.250063 21318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:37085
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=46097
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:02.251477 21318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:02.252864 21318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:02.267007 21327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:02.266960 21325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:02.267058 21324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:02.273273 21318 server_base.cc:1034] running on GCE node
I20260812 00:31:02.273998 21318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:02.275112 21318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:02.276346 21318 hybrid_clock.cc:648] HybridClock initialized: now 1786494662276245 us; error 104 us; skew 500 ppm
I20260812 00:31:02.276691 21318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:02 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494662, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:02.280566 21318 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:31:02.282210 21318 webserver.cc:460] Webserver started at http://127.29.190.130:46097/ using document root <none> and password file <none>
I20260812 00:31:02.283039 21318 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:02.283205 21318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:02.290041 21318 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:31:02.293031 21336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:02.294441 21318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:31:02.294605 21318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "e67e2a01a0ac41348009e046c93915ab"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "f2c4e0f1e5885909eaf28eef3f86c6da"
server_key_iv: "432e18156d6380b3d671e82235b72c96"
server_key_version: "encryptionkey@0"
I20260812 00:31:02.295743 21318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:02.317773 21318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:02.322373 21318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:02.322643 21318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:02.323746 21318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:02.325115 21318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:31:02.325215 21318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:02.325287 21318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:02.325397 21318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:02.360960 21318 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:37085
I20260812 00:31:02.361029 21506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:37085 every 8 connection(s)
I20260812 00:31:02.362466 21318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:31:02.366626 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 21318
I20260812 00:31:02.367327 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:42925
--local_ip_for_outbound_sockets=127.29.190.131
--tserver_master_addrs=127.29.190.190:36209
--webserver_port=42417
--webserver_interface=127.29.190.131
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:46725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:31:02.367781 21509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:02.365705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:56453)
0812 00:31:02.366465 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:02.366775 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":304,"threads_started":1}
W20260812 00:31:02.368474 21507 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:36209 (0 consecutive failures): Network error: Failed to ping master at 127.29.190.190:36209: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
I20260812 00:31:02.369367 21509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:02.369045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:54865)
0812 00:31:02.369196 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:02.369262 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 00:31:02.370234 21509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:02.369926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:38921)
0812 00:31:02.370060 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:02.370129 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 00:31:02.370519 21507 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:31:02.729346 21511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:02.729652 21511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:02.729749 21511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:02.737157 21511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:02.737288 21511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:02.737412 21511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:31:02.747689 21511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:46725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:42925
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=42417
--tserver_master_addrs=127.29.190.190:36209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:02.748960 21511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:02.750464 21511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:02.764463 21518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:02.764377 21522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:02.764410 21524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:02.765475 21511 server_base.cc:1034] running on GCE node
I20260812 00:31:02.766119 21511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:02.767148 21511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:02.768383 21511 hybrid_clock.cc:648] HybridClock initialized: now 1786494662768265 us; error 109 us; skew 500 ppm
I20260812 00:31:02.768718 21511 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:02 dist-test-slave-c12x krb5kdc[19161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494662, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:02.772187 21511 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:31:02.773733 21511 webserver.cc:460] Webserver started at http://127.29.190.131:42417/ using document root <none> and password file <none>
I20260812 00:31:02.774467 21511 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:02.774621 21511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:02.779991 21511 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:31:02.782783 21535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:02.784288 21511 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:31:02.784505 21511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "309743121dea4633862118b72eea8b64"
format_stamp: "Formatted at 2026-08-12 00:30:56 on dist-test-slave-c12x"
server_key: "299123ead716aa2dcef4b8c19f6ab5da"
server_key_iv: "2762b5f8114e6310e8fdfc34b608f0fb"
server_key_version: "encryptionkey@0"
I20260812 00:31:02.785580 21511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:02.810271 21511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:02.814800 21511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:02.815096 21511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:02.816160 21511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:02.817507 21511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:31:02.817636 21511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:02.817775 21511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:02.817867 21511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:02.851536 21511 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:42925
I20260812 00:31:02.851627 21705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:42925 every 8 connection(s)
I20260812 00:31:02.853027 21511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:31:02.857440 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 21511
I20260812 00:31:02.857915 21711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:02.856040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:35201)
0812 00:31:02.856786 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:02.857052 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":272,"threads_started":1}
W20260812 00:31:02.858736 21706 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:36209 (0 consecutive failures): Network error: Failed to ping master at 127.29.190.190:36209: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
I20260812 00:31:02.859730 21711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:02.859335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:42583)
0812 00:31:02.859536 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:02.859621 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 00:31:02.860687 21711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:02.860294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:33475)
0812 00:31:02.860469 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:02.860567 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260812 00:31:02.860920 21706 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:31:02.876653 21713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:02.875829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:54297)
0812 00:31:02.876326 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:02.876409 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":282,"threads_started":1}
I20260812 00:31:03.371945 21717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:03.371052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:36779)
0812 00:31:03.371598 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:03.371718 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":235,"threads_started":1}
I20260812 00:31:03.862756 21719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:03.861609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:45391)
0812 00:31:03.862198 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:03.862396 (+ 198us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":295,"threads_started":1}
I20260812 00:31:03.878413 21720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:03.877646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:47495)
0812 00:31:03.878126 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:03.878216 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":256,"threads_started":1}
I20260812 00:31:04.373787 21723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:04.372972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:52519)
0812 00:31:04.373505 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:04.373598 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":257,"threads_started":1}
I20260812 00:31:04.864601 21724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:04.863816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:46515)
0812 00:31:04.864323 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:04.864411 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":257,"threads_started":1}
I20260812 00:31:04.880153 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:04.879371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:57401)
0812 00:31:04.879903 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:04.880000 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":289,"threads_started":1}
I20260812 00:31:05.375648 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:05.374772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:39763)
0812 00:31:05.375260 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:05.375343 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":266,"threads_started":1}
I20260812 00:31:05.866921 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:05.865958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:60049)
0812 00:31:05.866539 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:05.866662 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":295,"threads_started":1}
I20260812 00:31:05.881922 21732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:05.881146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:34059)
0812 00:31:05.881632 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:05.881715 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":245,"threads_started":1}
I20260812 00:31:06.377390 21735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:06.376645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:35437)
0812 00:31:06.377131 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:06.377216 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":240,"threads_started":1}
I20260812 00:31:06.868927 21736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:06.868189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:52145)
0812 00:31:06.868678 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:06.868761 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":264,"threads_started":1}
I20260812 00:31:06.884107 21739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:06.883084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:39215)
0812 00:31:06.883808 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:06.883925 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":373,"threads_started":1}
I20260812 00:31:07.379182 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:07.378361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:55677)
0812 00:31:07.378918 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:07.379005 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":281,"threads_started":1}
I20260812 00:31:07.870759 21742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:07.869954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:34871)
0812 00:31:07.870468 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:07.870585 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":253,"threads_started":1}
I20260812 00:31:07.885990 21743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:07.885134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:45851)
0812 00:31:07.885598 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:07.885687 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":225,"threads_started":1}
I20260812 00:31:08.381047 21745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:08.380221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:52413)
0812 00:31:08.380755 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:08.380855 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":278,"threads_started":1}
I20260812 00:31:08.872855 21748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:08.871942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:43559)
0812 00:31:08.872544 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:08.872641 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":340,"threads_started":1}
I20260812 00:31:08.887915 21749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:08.886983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:59049)
0812 00:31:08.887603 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:08.887701 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":241,"threads_started":1}
I20260812 00:31:09.383193 21751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:09.382199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:45417)
0812 00:31:09.382861 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:09.382957 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":317,"threads_started":1}
I20260812 00:31:09.875005 21752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:09.874023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:45603)
0812 00:31:09.874673 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:09.874767 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":259,"threads_started":1}
I20260812 00:31:09.889750 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:09.888859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:60159)
0812 00:31:09.889481 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:09.889568 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":252,"threads_started":1}
I20260812 00:31:10.385128 21754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:10.384339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:60021)
0812 00:31:10.384854 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:10.384949 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":258,"threads_started":1}
I20260812 00:31:10.876962 21756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:10.876115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:58037)
0812 00:31:10.876682 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:10.876775 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":318,"threads_started":1}
I20260812 00:31:10.891680 21757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:10.890838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:57749)
0812 00:31:10.891328 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:10.891426 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":244,"threads_started":1}
I20260812 00:31:11.387065 21758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:11.386242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:54989)
0812 00:31:11.386789 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:11.386878 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":273,"threads_started":1}
I20260812 00:31:11.878937 21759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:11.878073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:32873)
0812 00:31:11.878652 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:11.878755 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":311,"threads_started":1}
I20260812 00:31:11.894025 21760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:11.892935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:47961)
0812 00:31:11.893577 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:11.893675 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":735,"threads_started":1}
I20260812 00:31:12.389066 21761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:12.388128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:49145)
0812 00:31:12.388692 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:12.388788 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":311,"threads_started":1}
I20260812 00:31:12.880887 21762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:12.880110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:33281)
0812 00:31:12.880625 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:12.880715 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":260,"threads_started":1}
I20260812 00:31:12.896054 21764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:12.895192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:47231)
0812 00:31:12.895779 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:12.895869 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":353,"threads_started":1}
I20260812 00:31:13.390931 21765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:13.390096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:40239)
0812 00:31:13.390632 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:13.390741 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":270,"threads_started":1}
I20260812 00:31:13.882905 21766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:13.881969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:50509)
0812 00:31:13.882551 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:13.882674 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":291,"threads_started":1}
I20260812 00:31:13.897800 21769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:13.896992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:45251)
0812 00:31:13.897527 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:13.897621 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":304,"threads_started":1}
I20260812 00:31:14.392788 21770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:14.392000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:51281)
0812 00:31:14.392513 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:14.392607 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":258,"threads_started":1}
I20260812 00:31:14.884877 21772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:14.884123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:49771)
0812 00:31:14.884609 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:14.884714 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":230,"threads_started":1}
I20260812 00:31:14.899843 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:14.898909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:56391)
0812 00:31:14.899539 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:14.899659 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":282,"threads_started":1}
I20260812 00:31:15.394883 21774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:15.393877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:43881)
0812 00:31:15.394534 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:15.394645 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":355,"threads_started":1}
I20260812 00:31:15.887017 21775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:15.886047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:48337)
0812 00:31:15.886716 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:15.886821 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":374,"threads_started":1}
I20260812 00:31:15.901613 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:15.900827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:48671)
0812 00:31:15.901307 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:15.901400 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":239,"threads_started":1}
I20260812 00:31:16.396919 21778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:16.395999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:49051)
0812 00:31:16.396571 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:16.396677 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":278,"threads_started":1}
I20260812 00:31:16.888792 21779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:16.888027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:38865)
0812 00:31:16.888494 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:16.888605 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":227,"threads_started":1}
I20260812 00:31:16.903762 21780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:16.902863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.129:51559)
0812 00:31:16.903385 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:16.903587 (+ 202us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":256,"threads_started":1}
I20260812 00:31:17.399082 21781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:17.398246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.130:34083)
0812 00:31:17.398770 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:17.398890 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":282,"threads_started":1}
I20260812 00:31:17.867452 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 21063
I20260812 00:31:17.890870 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:17.890073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:36209 (local address 127.29.190.131:44203)
0812 00:31:17.890568 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:17.890687 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":251,"threads_started":1}
I20260812 00:31:17.894644 21785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:17.868807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39760 (local address 127.29.190.129:39051)
0812 00:31:17.869795 (+ 988us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:17.869818 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:17.869874 (+ 56us) server_negotiation.cc:407] Connection header received
0812 00:31:17.872350 (+ 2476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:17.872361 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:17.872842 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:17.873161 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:17.874716 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:17.876139 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:17.877448 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:17.878131 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:17.878280 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:17.886959 (+ 8679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:17.886971 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:17.886990 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:17.887046 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:17.891046 (+ 4000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:17.891955 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:17.891963 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:17.891971 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:17.892141 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:17.892571 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:17.892576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:17.892578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:17.893206 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:17.893444 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:17.893853 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 00:31:17.894321 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":596,"threads_started":1}
I20260812 00:31:17.896246 21304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:17.982772 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 21063
I20260812 00:31:18.021732 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 21318
I20260812 00:31:18.049463 21789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:18.022869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34284 (local address 127.29.190.130:37085)
0812 00:31:18.024032 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:18.024068 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:18.024115 (+ 47us) server_negotiation.cc:407] Connection header received
0812 00:31:18.026726 (+ 2611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:18.026740 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:18.027282 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:18.027704 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:18.030634 (+ 2930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:18.032898 (+ 2264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:18.034516 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:18.035943 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:18.036189 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:18.040032 (+ 3843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:18.040058 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:18.040088 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:18.040159 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:18.044787 (+ 4628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:18.045812 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:18.045823 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:18.045837 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:18.046104 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:18.046589 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:18.046596 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:18.046602 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:18.047503 (+ 901us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:18.047852 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:18.048383 (+ 531us) server_negotiation.cc:299] Negotiation successful
0812 00:31:18.048913 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":903,"thread_start_us":718,"threads_started":1}
I20260812 00:31:18.050886 21501 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:18.135236 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 21318
I20260812 00:31:18.163635 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 21511
I20260812 00:31:18.182886 21792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:18.164715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49496 (local address 127.29.190.131:42925)
0812 00:31:18.165370 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:18.165384 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:18.165429 (+ 45us) server_negotiation.cc:407] Connection header received
0812 00:31:18.167165 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:18.167176 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:18.167816 (+ 640us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:18.168241 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:18.169750 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:18.171051 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:18.172478 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:18.173193 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:18.173415 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:18.176131 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:18.176139 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:18.176156 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:18.176197 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:18.179050 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:18.179922 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:18.179932 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:18.179942 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:18.180140 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:18.180600 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:18.180606 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:18.180611 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:18.181251 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:18.181600 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:18.182085 (+ 485us) server_negotiation.cc:299] Negotiation successful
0812 00:31:18.182581 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":322,"threads_started":1}
I20260812 00:31:18.184466 21700 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:18.269934 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 21511
2026-08-12T00:31:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25351 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:31:18 dist-test-slave-c12x krb5kdc[21799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:31:18 dist-test-slave-c12x krb5kdc[21799](info): set up 2 sockets
Aug 12 00:31:18 dist-test-slave-c12x krb5kdc[21799](info): commencing operation
krb5kdc: starting...
W20260812 00:31:19.669432 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.351s user 0.004s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:31:19 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:31:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:31:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:31:19.976675 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46283
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:31:20.335134 21826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:20.335605 21826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:20.335798 21826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:20.343556 21826 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:31:20.343741 21826 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:31:20.343851 21826 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:31:20.343961 21826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:31:20.344062 21826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:20.344180 21826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:20.344282 21826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:31:20.344383 21826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:31:20.355669 21826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:20.357182 21826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:20.358644 21826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:20.372077 21835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:20.372052 21836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:20.372181 21838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:20.372783 21826 server_base.cc:1034] running on GCE node
I20260812 00:31:20.373806 21826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:20.375479 21826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:20.376731 21826 hybrid_clock.cc:648] HybridClock initialized: now 1786494680376673 us; error 35 us; skew 500 ppm
I20260812 00:31:20.377064 21826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:20 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494680, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:20.380627 21826 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:31:20.382267 21826 webserver.cc:460] Webserver started at http://127.29.190.190:37019/ using document root <none> and password file <none>
I20260812 00:31:20.383023 21826 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:20.383167 21826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:20.383574 21826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:31:20.387171 21826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6"
format_stamp: "Formatted at 2026-08-12 00:31:20 on dist-test-slave-c12x"
server_key: "c226ba65e7ffa50994e9d23ce75a9152"
server_key_iv: "86060d2f91239fa3eb5ed4cddeecde60"
server_key_version: "encryptionkey@0"
I20260812 00:31:20.388103 21826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6"
format_stamp: "Formatted at 2026-08-12 00:31:20 on dist-test-slave-c12x"
server_key: "c226ba65e7ffa50994e9d23ce75a9152"
server_key_iv: "86060d2f91239fa3eb5ed4cddeecde60"
server_key_version: "encryptionkey@0"
I20260812 00:31:20.394203 21826 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 00:31:20.398295 21851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:20.399912 21826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:31:20.400141 21826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6"
format_stamp: "Formatted at 2026-08-12 00:31:20 on dist-test-slave-c12x"
server_key: "c226ba65e7ffa50994e9d23ce75a9152"
server_key_iv: "86060d2f91239fa3eb5ed4cddeecde60"
server_key_version: "encryptionkey@0"
I20260812 00:31:20.400394 21826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:20.417645 21826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:20.422442 21826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:20.422741 21826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:20.442984 21826 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46283
I20260812 00:31:20.443003 21935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46283 every 8 connection(s)
I20260812 00:31:20.444505 21826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:31:20.446904 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 21826
I20260812 00:31:20.447130 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:31:20.447881 30458 external_mini_cluster.cc:1428] Setting key e80c904fcdd58f23bec3f816cd70bb78
I20260812 00:31:20.448624 21936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:31:20.465222 21936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Bootstrap starting.
Aug 12 00:31:20 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:31:20.468847 21936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Neither blocks nor log segments found. Creating new log.
I20260812 00:31:20.470062 21936 log.cc:824] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:20.473148 21936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: No bootstrap required, opened a new log
I20260812 00:31:20.475013 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:20.450038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.29.190.190:46283)
0812 00:31:20.450877 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:20.450892 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:20.450943 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:31:20.454126 (+ 3183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:20.454160 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:20.454796 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:20.455270 (+ 474us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:20.457194 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:20.458527 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:20.460764 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:20.461605 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:20.461766 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:20.467020 (+ 5254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:20.467030 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:20.467047 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:20.467089 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:20.470782 (+ 3693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:20.471636 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:20.471644 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:20.471651 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:20.471832 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:20.472268 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:20.472273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:20.472275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:20.472810 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:20.473143 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:20.473606 (+ 463us) server_negotiation.cc:299] Negotiation successful
0812 00:31:20.474042 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":339,"threads_started":1}
I20260812 00:31:20.481796 21936 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:31:20.482193 21936 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:31:20.482306 21936 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9dcfa3c4ce44b4f840a4ccba73320a6, State: Initialized, Role: FOLLOWER
I20260812 00:31:20.482992 21936 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:31:20.483280 21936 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:31:20.483466 21936 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:31:20.483676 21936 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:20.486050 21936 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:31:20.486752 21936 leader_election.cc:302] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9dcfa3c4ce44b4f840a4ccba73320a6; no voters:
I20260812 00:31:20.487568 21936 leader_election.cc:288] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:31:20.487813 21943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:31:20.488519 21943 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 1 LEADER]: Becoming Leader. State: Replica: c9dcfa3c4ce44b4f840a4ccba73320a6, State: Running, Role: LEADER
I20260812 00:31:20.489090 21943 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:31:20.489856 21936 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:31:20.492166 21946 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9dcfa3c4ce44b4f840a4ccba73320a6. Latest consensus state: current_term: 1 leader_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } } }
I20260812 00:31:20.492635 21946 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:31:20.492483 21945 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } } }
I20260812 00:31:20.492821 21945 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:31:20.497423 21956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:31:20.502117 21956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:31:20.511579 21956 catalog_manager.cc:1347] Generated new cluster ID: bca6e7e257f8495ca51e49d997498406
I20260812 00:31:20.511792 21956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:31:20.521271 21956 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:31:20.523351 21956 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:31:20.531401 21956 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Generated new TSK 0
I20260812 00:31:20.532526 21956 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:31:20.608258 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46283
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:31:21.001024 21976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:21.001344 21976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:21.001442 21976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:21.009328 21976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:21.009460 21976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:21.009590 21976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:31:21.019901 21976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:21.021287 21976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:21.022739 21976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:21.037878 21990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:21.037834 21987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:21.037846 21985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:21.038795 21976 server_base.cc:1034] running on GCE node
I20260812 00:31:21.039639 21976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:21.040736 21976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:21.041994 21976 hybrid_clock.cc:648] HybridClock initialized: now 1786494681041947 us; error 41 us; skew 500 ppm
I20260812 00:31:21.042374 21976 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:21 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494681, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:21.045861 21976 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:31:21.047506 21976 webserver.cc:460] Webserver started at http://127.29.190.129:35269/ using document root <none> and password file <none>
I20260812 00:31:21.048219 21976 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:21.048323 21976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:21.048604 21976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:31:21.051774 21976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "ed09251fd6e14a52aa9b6f24d84fda4b"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "a81c3a834ef89721553424caf656ff81"
server_key_iv: "8e6a2f37fb6563db3a8dfe84336cb046"
server_key_version: "encryptionkey@0"
I20260812 00:31:21.052513 21976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "ed09251fd6e14a52aa9b6f24d84fda4b"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "a81c3a834ef89721553424caf656ff81"
server_key_iv: "8e6a2f37fb6563db3a8dfe84336cb046"
server_key_version: "encryptionkey@0"
I20260812 00:31:21.057906 21976 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:31:21.061740 21999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:21.063167 21976 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:31:21.063496 21976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "ed09251fd6e14a52aa9b6f24d84fda4b"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "a81c3a834ef89721553424caf656ff81"
server_key_iv: "8e6a2f37fb6563db3a8dfe84336cb046"
server_key_version: "encryptionkey@0"
I20260812 00:31:21.063746 21976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:21.084196 21976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:21.088918 21976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:21.089305 21976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:21.090453 21976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:21.092029 21976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:31:21.092119 21976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:21.092303 21976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:21.092368 21976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:21.129781 21976 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:35923
I20260812 00:31:21.129827 22181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:35923 every 8 connection(s)
I20260812 00:31:21.131162 21976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:31:21.135571 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 21976
I20260812 00:31:21.135811 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:31:21.136705 30458 external_mini_cluster.cc:1428] Setting key 823610a964d2bd0b7f1e0ee0dc7cd5ab
Aug 12 00:31:21 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494681, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:31:21.155905 22184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:21.133982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:39099 (local address 127.29.190.190:46283)
0812 00:31:21.134513 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:21.134517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:21.135693 (+ 1176us) server_negotiation.cc:407] Connection header received
0812 00:31:21.138209 (+ 2516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:21.138213 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:21.138282 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:21.138384 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:21.140523 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:21.141269 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:21.143950 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:21.144392 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:21.144504 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:21.149255 (+ 4751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:21.149262 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:21.149265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:21.149303 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:21.152596 (+ 3293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:21.153402 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:21.153407 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:21.153410 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:21.153540 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:21.154015 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:21.154019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:21.154021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:21.154316 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:21.154493 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:21.155256 (+ 763us) server_negotiation.cc:299] Negotiation successful
0812 00:31:21.155534 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":246,"threads_started":1}
I20260812 00:31:21.156963 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:21.134577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:39099)
0812 00:31:21.135496 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:21.135555 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:21.137889 (+ 2334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:21.138713 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:21.138732 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:21.139416 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:31:21.140306 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:21.140335 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:21.141470 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:21.141478 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:21.143771 (+ 2293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:21.143791 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:21.144654 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:21.144665 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:21.145024 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:21.145898 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:31:21.145942 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:31:21.148940 (+ 2998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:31:21.152750 (+ 3810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:21.152760 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:21.152779 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:21.153239 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:21.153662 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:21.153667 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:21.153671 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:21.153872 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:21.154465 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:31:21.154474 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:31:21.154846 (+ 372us) client_negotiation.cc:769] Sending connection context
0812 00:31:21.155144 (+ 298us) client_negotiation.cc:240] Negotiation successful
0812 00:31:21.155751 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":277,"threads_started":1}
I20260812 00:31:21.158689 22182 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46283
I20260812 00:31:21.159060 22182 heartbeater.cc:464] Registering TS with master...
I20260812 00:31:21.160053 22182 heartbeater.cc:511] Master 127.29.190.190:46283 requested a full tablet report, sending...
I20260812 00:31:21.162555 21880 ts_manager.cc:194] Registered new tserver with Master: ed09251fd6e14a52aa9b6f24d84fda4b (127.29.190.129:35923)
I20260812 00:31:21.164844 21880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:39099
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:31:21.204363 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46283
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:31:21.557319 22188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:21.557612 22188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:21.557708 22188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:21.565738 22188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:21.565858 22188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:21.565980 22188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:31:21.576161 22188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:21.577451 22188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:21.578719 22188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:21.592809 22196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:21.592857 22202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:21.592782 22197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:21.593909 22188 server_base.cc:1034] running on GCE node
I20260812 00:31:21.594636 22188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:21.595621 22188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:21.596868 22188 hybrid_clock.cc:648] HybridClock initialized: now 1786494681596817 us; error 57 us; skew 500 ppm
I20260812 00:31:21.597216 22188 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:21 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494681, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:21.600524 22188 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:31:21.602095 22188 webserver.cc:460] Webserver started at http://127.29.190.130:44335/ using document root <none> and password file <none>
I20260812 00:31:21.602818 22188 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:21.602969 22188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:21.603281 22188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:31:21.606344 22188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "d3756a3615ad4a8cb2a53532a39ad043"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "3f600c8399043a99405ad74d1c305b04"
server_key_iv: "3cad9a85584cbe3dd611c686e7390197"
server_key_version: "encryptionkey@0"
I20260812 00:31:21.607131 22188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "d3756a3615ad4a8cb2a53532a39ad043"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "3f600c8399043a99405ad74d1c305b04"
server_key_iv: "3cad9a85584cbe3dd611c686e7390197"
server_key_version: "encryptionkey@0"
I20260812 00:31:21.612409 22188 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:31:21.618299 22214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:21.620257 22188 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.001s
I20260812 00:31:21.620414 22188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "d3756a3615ad4a8cb2a53532a39ad043"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "3f600c8399043a99405ad74d1c305b04"
server_key_iv: "3cad9a85584cbe3dd611c686e7390197"
server_key_version: "encryptionkey@0"
I20260812 00:31:21.620605 22188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:21.647650 22188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:21.652567 22188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:21.652832 22188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:21.653820 22188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:21.655268 22188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:31:21.655344 22188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:21.655480 22188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:21.655552 22188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260812 00:31:21.690810 22188 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:44123
I20260812 00:31:21.691015 22390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:44123 every 8 connection(s)
I20260812 00:31:21.692270 22188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:31:21.693645 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 22188
I20260812 00:31:21.693836 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:31:21.694416 30458 external_mini_cluster.cc:1428] Setting key 154a26a9b32e10b36a70fd67361a712e
Aug 12 00:31:21 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494681, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:31:21.715088 22395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:21.695688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:37099 (local address 127.29.190.190:46283)
0812 00:31:21.696212 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:21.696216 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:21.697364 (+ 1148us) server_negotiation.cc:407] Connection header received
0812 00:31:21.699340 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:21.699347 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:21.699457 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:21.699570 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:21.701167 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:21.701933 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:21.703677 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:21.704189 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:21.704334 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:21.708883 (+ 4549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:21.708889 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:21.708892 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:21.708926 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:21.711744 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:21.712544 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:21.712554 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:21.712556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:21.712696 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:21.713165 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:21.713169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:21.713171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:21.713467 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:21.713637 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:21.714442 (+ 805us) server_negotiation.cc:299] Negotiation successful
0812 00:31:21.714688 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":295,"threads_started":1}
I20260812 00:31:21.716250 22396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:21.696253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:37099)
0812 00:31:21.697203 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:21.697243 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:21.699050 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:21.699825 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:21.699834 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:21.700381 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:31:21.700981 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:21.700999 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:21.702108 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:21.702113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:21.703401 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:21.703425 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:21.704448 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:21.704457 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:21.704772 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:21.705686 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:31:21.705722 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:31:21.708620 (+ 2898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:31:21.711908 (+ 3288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:21.711919 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:21.711937 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:21.712398 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:21.712818 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:21.712823 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:21.712827 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:21.713030 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:21.713627 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:31:21.713636 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:31:21.714000 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 00:31:21.714310 (+ 310us) client_negotiation.cc:240] Negotiation successful
0812 00:31:21.714900 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":406,"threads_started":1}
I20260812 00:31:21.717868 22393 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46283
I20260812 00:31:21.718248 22393 heartbeater.cc:464] Registering TS with master...
I20260812 00:31:21.719026 22393 heartbeater.cc:511] Master 127.29.190.190:46283 requested a full tablet report, sending...
I20260812 00:31:21.720736 21880 ts_manager.cc:194] Registered new tserver with Master: d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123)
I20260812 00:31:21.721653 21880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:37099
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:31:21.759763 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46283
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:31:22.110180 22403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:22.110491 22403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:22.110662 22403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:22.118388 22403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:22.118508 22403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:22.118717 22403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:31:22.129087 22403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:22.130524 22403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:22.131930 22403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:22.145649 22410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:22.145674 22412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:22.145606 22415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:22.146418 22403 server_base.cc:1034] running on GCE node
I20260812 00:31:22.147033 22403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:22.148165 22403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:22.149402 22403 hybrid_clock.cc:648] HybridClock initialized: now 1786494682149342 us; error 58 us; skew 500 ppm
I20260812 00:31:22.149730 22403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:22 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494682, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:22.152998 22403 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:31:22.154486 22403 webserver.cc:460] Webserver started at http://127.29.190.131:36249/ using document root <none> and password file <none>
I20260812 00:31:22.155205 22403 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:22.155356 22403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:22.155731 22403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:31:22.158752 22403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "a49308d8407e4e63a5e74d9ded53dcc7"
format_stamp: "Formatted at 2026-08-12 00:31:22 on dist-test-slave-c12x"
server_key: "a29e8210b89a393160abce9b1a5d4e51"
server_key_iv: "9da2ee1be6f0adefcbabd1b8d50b4dca"
server_key_version: "encryptionkey@0"
I20260812 00:31:22.159601 22403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "a49308d8407e4e63a5e74d9ded53dcc7"
format_stamp: "Formatted at 2026-08-12 00:31:22 on dist-test-slave-c12x"
server_key: "a29e8210b89a393160abce9b1a5d4e51"
server_key_iv: "9da2ee1be6f0adefcbabd1b8d50b4dca"
server_key_version: "encryptionkey@0"
I20260812 00:31:22.164723 22403 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 00:31:22.168255 22425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:22.168933 22182 heartbeater.cc:503] Master 127.29.190.190:46283 was elected leader, sending a full tablet report...
I20260812 00:31:22.170074 22403 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:31:22.170245 22403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "a49308d8407e4e63a5e74d9ded53dcc7"
format_stamp: "Formatted at 2026-08-12 00:31:22 on dist-test-slave-c12x"
server_key: "a29e8210b89a393160abce9b1a5d4e51"
server_key_iv: "9da2ee1be6f0adefcbabd1b8d50b4dca"
server_key_version: "encryptionkey@0"
I20260812 00:31:22.170432 22403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:22.206063 22403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:22.210124 22403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:22.210429 22403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:22.211484 22403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:22.212873 22403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:31:22.212989 22403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:22.213151 22403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:22.213231 22403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:22.247781 22403 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:35289
I20260812 00:31:22.247872 22577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:35289 every 8 connection(s)
I20260812 00:31:22.249173 22403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:31:22.250178 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 22403
I20260812 00:31:22.250382 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:31:22.250936 30458 external_mini_cluster.cc:1428] Setting key 88b4a83a92b0131b4a81e4b13077647b
Aug 12 00:31:22 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494682, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:31:22.272112 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.252187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:42741 (local address 127.29.190.190:46283)
0812 00:31:22.252722 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.252726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.254134 (+ 1408us) server_negotiation.cc:407] Connection header received
0812 00:31:22.256247 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.256253 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.256323 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.256435 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:22.258006 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.258799 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.260505 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.260985 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.261115 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.264968 (+ 3853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:22.264976 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:22.264980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:22.265019 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:22.268758 (+ 3739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.269600 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.269612 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.269615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.269746 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.270236 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.270241 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.270243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.270526 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:22.270698 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.271462 (+ 764us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.271698 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":301,"threads_started":1}
I20260812 00:31:22.273145 22582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.252998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:42741)
0812 00:31:22.253936 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:22.254001 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:22.255971 (+ 1970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:22.256656 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:22.256664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:22.257230 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:31:22.257808 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.257826 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.258962 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.258967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.260319 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.260332 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.261246 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.261252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.261482 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.262324 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:31:22.262353 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:31:22.264691 (+ 2338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:31:22.268941 (+ 4250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:22.268952 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:22.268979 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:22.269459 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:22.269868 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:22.269873 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:22.269877 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:22.270099 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:22.270665 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:31:22.270674 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:31:22.271055 (+ 381us) client_negotiation.cc:769] Sending connection context
0812 00:31:22.271343 (+ 288us) client_negotiation.cc:240] Negotiation successful
0812 00:31:22.271942 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":415,"threads_started":1}
I20260812 00:31:22.274791 22579 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46283
I20260812 00:31:22.275193 22579 heartbeater.cc:464] Registering TS with master...
I20260812 00:31:22.276201 22579 heartbeater.cc:511] Master 127.29.190.190:46283 requested a full tablet report, sending...
I20260812 00:31:22.277814 21880 ts_manager.cc:194] Registered new tserver with Master: a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
I20260812 00:31:22.278901 21880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:42741
I20260812 00:31:22.280565 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:31:22.300789 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.286004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.29.190.190:46283)
0812 00:31:22.286219 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.286224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.286814 (+ 590us) server_negotiation.cc:407] Connection header received
0812 00:31:22.287018 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.287022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.287088 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.287202 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:22.288926 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.289747 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.291584 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.292005 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.292115 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.295050 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:22.295055 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:22.295058 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:22.295095 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:22.297877 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.298697 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.298701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.298703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.298829 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.299309 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.299313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.299315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.299784 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:22.299986 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.300317 (+ 331us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.300535 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 00:31:22.305341 21880 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58114:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:31:22.313166 21880 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:31:22.337304 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.326071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58904 (local address 127.29.190.131:35289)
0812 00:31:22.327049 (+ 978us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.327062 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.328369 (+ 1307us) server_negotiation.cc:407] Connection header received
0812 00:31:22.328704 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.328716 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.329024 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.329241 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:22.331166 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.332667 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.334921 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.335923 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.336132 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.336321 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.336791 (+ 470us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.336968 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":561,"threads_started":1}
I20260812 00:31:22.337317 22605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.325842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:35289 (local address 127.0.0.1:58904)
0812 00:31:22.328142 (+ 2300us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:22.328209 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:22.328433 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:22.329721 (+ 1288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:22.329732 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:22.329774 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:22.330429 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.330449 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.332790 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.332796 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.334761 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.334776 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.336131 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.336138 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.336462 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.336530 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 00:31:22.336714 (+ 184us) client_negotiation.cc:240] Negotiation successful
0812 00:31:22.336898 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1971,"mutex_wait_us":13,"thread_start_us":2388,"threads_started":1}
I20260812 00:31:22.339535 22608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.326758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40752 (local address 127.29.190.129:35923)
0812 00:31:22.327426 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.327467 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.328876 (+ 1409us) server_negotiation.cc:407] Connection header received
0812 00:31:22.329004 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.329016 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.329311 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.329530 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:22.332107 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.333655 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.336498 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.338068 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.338266 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.338417 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.338966 (+ 549us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.339162 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":310,"threads_started":1}
I20260812 00:31:22.340283 22603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.326182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:40752)
0812 00:31:22.328561 (+ 2379us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:22.328579 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:22.328722 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:22.329830 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:22.329843 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:22.329882 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:22.330941 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.330954 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.333816 (+ 2862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.333821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.336300 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.336318 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.338578 (+ 2260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.338586 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.338749 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.338776 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 00:31:22.339733 (+ 957us) client_negotiation.cc:240] Negotiation successful
0812 00:31:22.339890 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2227,"mutex_wait_us":552,"thread_start_us":1457,"threads_started":1}
I20260812 00:31:22.340418 22612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.328849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48076 (local address 127.29.190.130:44123)
0812 00:31:22.331379 (+ 2530us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.331385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.331406 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:31:22.331549 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.331554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.331710 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.331847 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:22.332512 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.333980 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.336678 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.338065 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.338245 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.338419 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.339925 (+ 1506us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.340105 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2381,"thread_start_us":2286,"threads_started":1}
I20260812 00:31:22.340835 22611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.328624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:44123 (local address 127.0.0.1:48076)
0812 00:31:22.330682 (+ 2058us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:22.330705 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:22.330860 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:22.331883 (+ 1023us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:22.331888 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:22.331913 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:22.332323 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.332334 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.334150 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.334155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.336535 (+ 2380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.336545 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.338279 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.338286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.338450 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.338487 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 00:31:22.338591 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:31:22.338726 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1889,"mutex_wait_us":65,"thread_start_us":1710,"threads_started":1}
I20260812 00:31:22.341980 22491 tablet_service.cc:1467] Processing CreateTablet for tablet 1a342132d02f43d19f46f869fd7c602e (DEFAULT_TABLE table=test-table [id=ef6bdc28ff4245bcbedcf70f844338b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:31:22.343653 22491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a342132d02f43d19f46f869fd7c602e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:31:22.343870 22291 tablet_service.cc:1467] Processing CreateTablet for tablet 1a342132d02f43d19f46f869fd7c602e (DEFAULT_TABLE table=test-table [id=ef6bdc28ff4245bcbedcf70f844338b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:31:22.343988 22079 tablet_service.cc:1467] Processing CreateTablet for tablet 1a342132d02f43d19f46f869fd7c602e (DEFAULT_TABLE table=test-table [id=ef6bdc28ff4245bcbedcf70f844338b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:31:22.344982 22291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a342132d02f43d19f46f869fd7c602e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:31:22.345299 22079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a342132d02f43d19f46f869fd7c602e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:31:22.355949 22613 tablet_bootstrap.cc:492] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Bootstrap starting.
I20260812 00:31:22.358187 22614 tablet_bootstrap.cc:492] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Bootstrap starting.
I20260812 00:31:22.360204 22613 tablet_bootstrap.cc:654] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Neither blocks nor log segments found. Creating new log.
I20260812 00:31:22.361555 22613 log.cc:824] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:22.361728 22614 tablet_bootstrap.cc:654] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Neither blocks nor log segments found. Creating new log.
I20260812 00:31:22.362475 22615 tablet_bootstrap.cc:492] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: Bootstrap starting.
I20260812 00:31:22.363169 22614 log.cc:824] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:22.365971 22613 tablet_bootstrap.cc:492] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: No bootstrap required, opened a new log
I20260812 00:31:22.366266 22613 ts_tablet_manager.cc:1397] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20260812 00:31:22.366307 22615 tablet_bootstrap.cc:654] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: Neither blocks nor log segments found. Creating new log.
I20260812 00:31:22.366534 22614 tablet_bootstrap.cc:492] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: No bootstrap required, opened a new log
I20260812 00:31:22.366905 22614 ts_tablet_manager.cc:1397] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 00:31:22.367774 22615 log.cc:824] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:22.370987 22615 tablet_bootstrap.cc:492] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: No bootstrap required, opened a new log
I20260812 00:31:22.371273 22615 ts_tablet_manager.cc:1397] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 00:31:22.374645 22613 raft_consensus.cc:348] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.375150 22613 raft_consensus.cc:374] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:31:22.375258 22613 raft_consensus.cc:729] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3756a3615ad4a8cb2a53532a39ad043, State: Initialized, Role: FOLLOWER
I20260812 00:31:22.376057 22613 consensus_queue.cc:260] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.377347 22393 heartbeater.cc:503] Master 127.29.190.190:46283 was elected leader, sending a full tablet report...
I20260812 00:31:22.378165 22613 ts_tablet_manager.cc:1428] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
I20260812 00:31:22.378153 22614 raft_consensus.cc:348] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.378579 22614 raft_consensus.cc:374] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:31:22.378685 22614 raft_consensus.cc:729] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a49308d8407e4e63a5e74d9ded53dcc7, State: Initialized, Role: FOLLOWER
I20260812 00:31:22.379478 22614 consensus_queue.cc:260] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.383388 22579 heartbeater.cc:503] Master 127.29.190.190:46283 was elected leader, sending a full tablet report...
I20260812 00:31:22.384348 22614 ts_tablet_manager.cc:1428] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260812 00:31:22.384581 22615 raft_consensus.cc:348] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.385052 22615 raft_consensus.cc:374] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:31:22.385171 22615 raft_consensus.cc:729] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed09251fd6e14a52aa9b6f24d84fda4b, State: Initialized, Role: FOLLOWER
I20260812 00:31:22.385897 22615 consensus_queue.cc:260] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.388123 22615 ts_tablet_manager.cc:1428] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20260812 00:31:22.441393 22619 raft_consensus.cc:482] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:31:22.441787 22619 raft_consensus.cc:504] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.443691 22619 leader_election.cc:288] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289), ed09251fd6e14a52aa9b6f24d84fda4b (127.29.190.129:35923)
W20260812 00:31:22.444789 22394 tablet.cc:2369] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:31:22.452894 22608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.445197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:48561 (local address 127.29.190.129:35923)
0812 00:31:22.445930 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.445937 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.446571 (+ 634us) server_negotiation.cc:407] Connection header received
0812 00:31:22.446722 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.446728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.446801 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.446912 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:22.447561 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.448626 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.450763 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.451865 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.452038 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.452116 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.452483 (+ 367us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.452628 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544}
I20260812 00:31:22.453050 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.444104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.29.190.130:48561)
0812 00:31:22.446452 (+ 2348us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:22.446470 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:22.446593 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:22.446956 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:22.446961 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:22.446987 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:22.447363 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.447374 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.448788 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.448792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.450577 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.450592 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.452093 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.452100 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.452277 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.452315 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:31:22.452417 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 00:31:22.452597 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2224,"mutex_wait_us":52,"thread_start_us":2005,"threads_started":1}
I20260812 00:31:22.453940 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.443857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:35289 (local address 127.29.190.130:36085)
0812 00:31:22.444661 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:22.444684 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:22.444876 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:22.445590 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:22.445598 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:22.445628 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:22.446099 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.446117 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.448798 (+ 2681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.448804 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.451154 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:22.451171 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.453034 (+ 1863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.453044 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:22.453279 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.453317 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:31:22.453427 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 00:31:22.453569 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":60,"thread_start_us":420,"threads_started":1}
I20260812 00:31:22.454396 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.444725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:36085 (local address 127.29.190.131:35289)
0812 00:31:22.444920 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.444927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.444948 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:31:22.445184 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.445192 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.445277 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.445347 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:22.446318 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.447396 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.451348 (+ 3952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.452613 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.452772 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.452835 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.453477 (+ 642us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.453617 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:31:22.454231 22116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a342132d02f43d19f46f869fd7c602e" candidate_uuid: "d3756a3615ad4a8cb2a53532a39ad043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" is_pre_election: true
I20260812 00:31:22.454808 22116 raft_consensus.cc:2454] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3756a3615ad4a8cb2a53532a39ad043 in term 0.
I20260812 00:31:22.455411 22515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a342132d02f43d19f46f869fd7c602e" candidate_uuid: "d3756a3615ad4a8cb2a53532a39ad043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" is_pre_election: true
I20260812 00:31:22.455585 22215 leader_election.cc:302] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3756a3615ad4a8cb2a53532a39ad043, ed09251fd6e14a52aa9b6f24d84fda4b; no voters:
I20260812 00:31:22.456005 22619 raft_consensus.cc:2781] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:31:22.455991 22515 raft_consensus.cc:2454] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3756a3615ad4a8cb2a53532a39ad043 in term 0.
I20260812 00:31:22.456172 22619 raft_consensus.cc:482] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:31:22.456287 22619 raft_consensus.cc:3037] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:22.458671 22619 raft_consensus.cc:504] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.459399 22619 leader_election.cc:288] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [CANDIDATE]: Term 1 election: Requested vote from peers a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289), ed09251fd6e14a52aa9b6f24d84fda4b (127.29.190.129:35923)
I20260812 00:31:22.460125 22515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a342132d02f43d19f46f869fd7c602e" candidate_uuid: "d3756a3615ad4a8cb2a53532a39ad043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a49308d8407e4e63a5e74d9ded53dcc7"
I20260812 00:31:22.460125 22116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a342132d02f43d19f46f869fd7c602e" candidate_uuid: "d3756a3615ad4a8cb2a53532a39ad043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b"
I20260812 00:31:22.460345 22116 raft_consensus.cc:3037] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:22.460345 22515 raft_consensus.cc:3037] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:22.464344 22515 raft_consensus.cc:2454] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3756a3615ad4a8cb2a53532a39ad043 in term 1.
I20260812 00:31:22.464344 22116 raft_consensus.cc:2454] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3756a3615ad4a8cb2a53532a39ad043 in term 1.
I20260812 00:31:22.464958 22216 leader_election.cc:302] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a49308d8407e4e63a5e74d9ded53dcc7, d3756a3615ad4a8cb2a53532a39ad043; no voters:
I20260812 00:31:22.465366 22619 raft_consensus.cc:2781] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:31:22.465818 22619 raft_consensus.cc:686] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 1 LEADER]: Becoming Leader. State: Replica: d3756a3615ad4a8cb2a53532a39ad043, State: Running, Role: LEADER
I20260812 00:31:22.466444 22619 consensus_queue.cc:237] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } }
I20260812 00:31:22.471725 21880 catalog_manager.cc:5495] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "d3756a3615ad4a8cb2a53532a39ad043" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } health_report { overall_health: HEALTHY } } }
W20260812 00:31:22.501104 22580 tablet.cc:2369] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:31:22.506999 22612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.501379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48090 (local address 127.29.190.130:44123)
0812 00:31:22.501596 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.501601 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.501620 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:31:22.501859 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.501864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.501948 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.502080 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:31:22.502480 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.503191 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.504847 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.505364 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.505468 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.505988 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:31:22.506522 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:31:22.506631 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.506720 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.506786 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:31:22.515305 22116 raft_consensus.cc:1261] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Refusing update from remote peer d3756a3615ad4a8cb2a53532a39ad043: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:31:22.515305 22515 raft_consensus.cc:1261] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 1 FOLLOWER]: Refusing update from remote peer d3756a3615ad4a8cb2a53532a39ad043: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:31:22.516289 22629 consensus_queue.cc:1035] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:31:22.516626 22619 consensus_queue.cc:1035] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:31:22.527163 22639 mvcc.cc:205] Tried to move back new op lower bound from 7317482219572506624 to 7317482219386986496. Current Snapshot: MvccSnapshot[applied={T|T < 7317482219572506624}]
I20260812 00:31:22.528177 22634 mvcc.cc:205] Tried to move back new op lower bound from 7317482219572506624 to 7317482219386986496. Current Snapshot: MvccSnapshot[applied={T|T < 7317482219572506624}]
I20260812 00:31:22.535928 22638 mvcc.cc:205] Tried to move back new op lower bound from 7317482219572506624 to 7317482219386986496. Current Snapshot: MvccSnapshot[applied={T|T < 7317482219572506624}]
I20260812 00:31:22.545046 21874 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:31:22.545395 21874 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:31:22.549578 21874 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Sending DeleteTablet for 3 replicas of tablet 1a342132d02f43d19f46f869fd7c602e
I20260812 00:31:22.550874 22491 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a342132d02f43d19f46f869fd7c602e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:22 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:58904
I20260812 00:31:22.550875 22291 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a342132d02f43d19f46f869fd7c602e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:22 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:48076
I20260812 00:31:22.551546 22079 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a342132d02f43d19f46f869fd7c602e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:22 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:40752
I20260812 00:31:22.553803 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 21976
I20260812 00:31:22.566357 22650 tablet_replica.cc:330] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: stopping tablet replica
I20260812 00:31:22.566972 22650 raft_consensus.cc:2229] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:31:22.567713 22648 tablet_replica.cc:330] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: stopping tablet replica
I20260812 00:31:22.568418 22648 raft_consensus.cc:2229] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:31:22.569152 22648 raft_consensus.cc:2258] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:22.570253 22650 raft_consensus.cc:2258] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:22.572801 22648 ts_tablet_manager.cc:1905] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:22.574604 22651 tablet_replica.cc:330] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: stopping tablet replica
I20260812 00:31:22.575023 22651 raft_consensus.cc:2229] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:31:22.576314 22650 ts_tablet_manager.cc:1905] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:22.579001 22651 raft_consensus.cc:2258] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:22.580431 22648 ts_tablet_manager.cc:1918] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:22.580610 22648 log.cc:1196] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/1a342132d02f43d19f46f869fd7c602e
I20260812 00:31:22.581187 22648 ts_tablet_manager.cc:1939] T 1a342132d02f43d19f46f869fd7c602e P a49308d8407e4e63a5e74d9ded53dcc7: Deleting consensus metadata
I20260812 00:31:22.581369 22651 ts_tablet_manager.cc:1905] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:22.583135 21854 catalog_manager.cc:4841] TS a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289): tablet 1a342132d02f43d19f46f869fd7c602e (table test-table [id=ef6bdc28ff4245bcbedcf70f844338b3]) successfully deleted
I20260812 00:31:22.583849 22650 ts_tablet_manager.cc:1918] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:22.584048 22650 log.cc:1196] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/1a342132d02f43d19f46f869fd7c602e
I20260812 00:31:22.584649 22650 ts_tablet_manager.cc:1939] T 1a342132d02f43d19f46f869fd7c602e P d3756a3615ad4a8cb2a53532a39ad043: Deleting consensus metadata
I20260812 00:31:22.586869 21854 catalog_manager.cc:4841] TS d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123): tablet 1a342132d02f43d19f46f869fd7c602e (table test-table [id=ef6bdc28ff4245bcbedcf70f844338b3]) successfully deleted
Aug 12 00:31:22 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:31:22.589716 22651 ts_tablet_manager.cc:1918] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:22.589890 22651 log.cc:1196] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/1a342132d02f43d19f46f869fd7c602e
I20260812 00:31:22.590554 22651 ts_tablet_manager.cc:1939] T 1a342132d02f43d19f46f869fd7c602e P ed09251fd6e14a52aa9b6f24d84fda4b: Deleting consensus metadata
I20260812 00:31:22.592569 21853 catalog_manager.cc:4841] TS ed09251fd6e14a52aa9b6f24d84fda4b (127.29.190.129:35923): tablet 1a342132d02f43d19f46f869fd7c602e (table test-table [id=ef6bdc28ff4245bcbedcf70f844338b3]) successfully deleted
I20260812 00:31:22.598233 22608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.555458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40766 (local address 127.29.190.129:35923)
0812 00:31:22.555695 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.555704 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.571222 (+ 15518us) server_negotiation.cc:407] Connection header received
0812 00:31:22.571801 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.571807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.571897 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.571992 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:22.575570 (+ 3578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.576730 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.583570 (+ 6840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.584224 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.584354 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.590527 (+ 6173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:22.590554 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:22.590575 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:22.590633 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:22.594896 (+ 4263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.595927 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.595938 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.595942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.596125 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.596515 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.596521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.596525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.597003 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:22.597327 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.597616 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.597842 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:31:22.598979 22176 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:22.689997 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 21976
I20260812 00:31:22.719820 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 22188
Aug 12 00:31:22 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:31:22.737340 22612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.720679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48102 (local address 127.29.190.130:44123)
0812 00:31:22.720876 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.720882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.721058 (+ 176us) server_negotiation.cc:407] Connection header received
0812 00:31:22.721277 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.721289 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.721352 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.721485 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:22.722829 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.723950 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.725711 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.726193 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.726335 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.730927 (+ 4592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:22.730941 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:22.730954 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:22.731004 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:22.734228 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.734983 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.734995 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.734998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.735154 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.735655 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.735662 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.735670 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.736066 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:22.736423 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.736735 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.736974 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:31:22.738233 22383 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:22.853219 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 22188
I20260812 00:31:22.883769 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 22403
Aug 12 00:31:22 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:31:22.904990 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:22.884746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58916 (local address 127.29.190.131:35289)
0812 00:31:22.885010 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:22.885019 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:22.885045 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:31:22.885117 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:22.885121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:22.885193 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:22.885278 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:22.886631 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.887392 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.888967 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:22.889395 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:22.889523 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:22.898721 (+ 9198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:22.898743 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:22.898762 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:22.898806 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:22.901787 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.902642 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.902651 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.902654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.902819 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:22.903222 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:22.903226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:22.903228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:22.903764 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:22.904066 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:22.904447 (+ 381us) server_negotiation.cc:299] Negotiation successful
0812 00:31:22.904667 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:31:22.905684 22573 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:22.996484 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 22403
I20260812 00:31:23.017984 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 21826
I20260812 00:31:23.019210 21929 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:23.131349 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 21826
I20260812 00:31:43.164047 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46283
--webserver_interface=127.29.190.190
--webserver_port=37019
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:31:43.526283 22659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:43.526712 22659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:43.526894 22659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:43.534587 22659 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:31:43.534765 22659 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:31:43.534873 22659 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:31:43.534982 22659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:31:43.535096 22659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:43.535239 22659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:43.535342 22659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:31:43.535470 22659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:31:43.547211 22659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=37019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:43.548687 22659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:43.550215 22659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:43.577917 22670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:43.577893 22671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:43.577940 22673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:43.578698 22659 server_base.cc:1034] running on GCE node
I20260812 00:31:43.579746 22659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:43.581377 22659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:43.582659 22659 hybrid_clock.cc:648] HybridClock initialized: now 1786494703582575 us; error 43 us; skew 500 ppm
I20260812 00:31:43.583141 22659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:43 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494703, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:43.591300 22659 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:31:43.593205 22659 webserver.cc:460] Webserver started at http://127.29.190.190:37019/ using document root <none> and password file <none>
I20260812 00:31:43.594101 22659 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:43.594269 22659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:43.600703 22659 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:31:43.603925 22684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:43.605367 22659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:31:43.605572 22659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6"
format_stamp: "Formatted at 2026-08-12 00:31:20 on dist-test-slave-c12x"
server_key: "c226ba65e7ffa50994e9d23ce75a9152"
server_key_iv: "86060d2f91239fa3eb5ed4cddeecde60"
server_key_version: "encryptionkey@0"
I20260812 00:31:43.606686 22659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:43.625444 22659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:43.630735 22659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:43.631078 22659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:43.652352 22659 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46283
I20260812 00:31:43.652419 22770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46283 every 8 connection(s)
I20260812 00:31:43.654109 22659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:31:43.656407 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 22659
I20260812 00:31:43.657603 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:35923
--local_ip_for_outbound_sockets=127.29.190.129
--tserver_master_addrs=127.29.190.190:46283
--webserver_port=35269
--webserver_interface=127.29.190.129
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:31:43.665337 22771 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:31:43.671193 22771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Bootstrap starting.
I20260812 00:31:43.693544 22771 log.cc:824] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:43.707545 22771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:31:43.708168 22771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Bootstrap complete.
I20260812 00:31:43.718899 22771 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:31:43.719869 22771 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9dcfa3c4ce44b4f840a4ccba73320a6, State: Initialized, Role: FOLLOWER
I20260812 00:31:43.720670 22771 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:31:43.720943 22771 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:31:43.721096 22771 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:31:43.721297 22771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 00:31:43.725627 22771 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:31:43.726248 22771 leader_election.cc:302] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9dcfa3c4ce44b4f840a4ccba73320a6; no voters:
I20260812 00:31:43.726997 22771 leader_election.cc:288] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 00:31:43.727169 22779 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 00:31:43.728495 22779 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 2 LEADER]: Becoming Leader. State: Replica: c9dcfa3c4ce44b4f840a4ccba73320a6, State: Running, Role: LEADER
I20260812 00:31:43.729272 22779 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:31:43.729598 22771 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:31:43.731997 22781 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9dcfa3c4ce44b4f840a4ccba73320a6. Latest consensus state: current_term: 2 leader_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } } }
I20260812 00:31:43.732391 22781 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:31:43.733008 22780 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } } }
I20260812 00:31:43.733333 22780 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:31:43.735515 22789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:31:43.750751 22789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:31:43.752832 22789 catalog_manager.cc:1259] Loaded cluster ID: bca6e7e257f8495ca51e49d997498406
I20260812 00:31:43.753057 22789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:31:43.757769 22800 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:31:43.758422 22789 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:31:43.760337 22789 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Loaded TSK: 0
I20260812 00:31:43.783527 22789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Generated new TSK 1
I20260812 00:31:43.784029 22789 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:31:44.055105 22774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:44.055433 22774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:44.055632 22774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:44.063030 22774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:44.063187 22774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:44.063360 22774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:31:44.073374 22774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:35923
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=35269
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:44.074790 22774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:44.076233 22774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:44.091270 22810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:44.091332 22813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:44.091866 22818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:44.093192 22774 server_base.cc:1034] running on GCE node
I20260812 00:31:44.093839 22774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:44.094946 22774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:44.096194 22774 hybrid_clock.cc:648] HybridClock initialized: now 1786494704096132 us; error 57 us; skew 500 ppm
I20260812 00:31:44.096525 22774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:44 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494704, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:44.099987 22774 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:31:44.101650 22774 webserver.cc:460] Webserver started at http://127.29.190.129:35269/ using document root <none> and password file <none>
I20260812 00:31:44.102362 22774 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:44.102538 22774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:44.108493 22774 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:31:44.111763 22826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:44.113451 22774 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 00:31:44.113638 22774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "ed09251fd6e14a52aa9b6f24d84fda4b"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "a81c3a834ef89721553424caf656ff81"
server_key_iv: "8e6a2f37fb6563db3a8dfe84336cb046"
server_key_version: "encryptionkey@0"
I20260812 00:31:44.115053 22774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:44.135731 22774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:44.140272 22774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:44.140529 22774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:44.141486 22774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:44.142773 22774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:31:44.142868 22774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:44.142956 22774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:44.143013 22774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:44.177294 22774 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:35923
I20260812 00:31:44.177390 23002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:35923 every 8 connection(s)
I20260812 00:31:44.178964 22774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:31:44.182533 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 22774
I20260812 00:31:44.183311 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:44123
--local_ip_for_outbound_sockets=127.29.190.130
--tserver_master_addrs=127.29.190.190:46283
--webserver_port=44335
--webserver_interface=127.29.190.130
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:31:44 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494704, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:31:44.207670 23006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:44.182228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:44287 (local address 127.29.190.190:46283)
0812 00:31:44.183082 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:44.183104 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:44.184261 (+ 1157us) server_negotiation.cc:407] Connection header received
0812 00:31:44.186521 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:44.186543 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:44.186991 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:44.187411 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:44.188915 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:44.191018 (+ 2103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:44.192750 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:44.193882 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:44.194093 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:44.199292 (+ 5199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:44.199301 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:44.199316 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:44.199356 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:44.202534 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:44.203666 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:44.203674 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:44.203680 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:44.203843 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:44.204508 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:44.204512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:44.204514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:44.205030 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:44.205199 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:44.206225 (+ 1026us) server_negotiation.cc:299] Negotiation successful
0812 00:31:44.206570 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":333,"threads_started":1}
I20260812 00:31:44.208401 23007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:44.182252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:44287)
0812 00:31:44.184061 (+ 1809us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:44.184109 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:44.185910 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:44.187621 (+ 1711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:44.187628 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:44.188156 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:31:44.188704 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:44.188721 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:44.191219 (+ 2498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:44.191223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:44.192593 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:44.192606 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:44.194149 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:44.194155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:44.194559 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:44.195500 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:31:44.195543 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:31:44.198940 (+ 3397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:31:44.202714 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:44.202727 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:44.202747 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:44.203506 (+ 759us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:44.203991 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:44.203999 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:44.204006 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:44.204294 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:44.205200 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:31:44.205212 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:31:44.205695 (+ 483us) client_negotiation.cc:769] Sending connection context
0812 00:31:44.206045 (+ 350us) client_negotiation.cc:240] Negotiation successful
0812 00:31:44.206728 (+ 683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1527,"thread_start_us":1345,"threads_started":1}
I20260812 00:31:44.211414 23004 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46283
I20260812 00:31:44.211815 23004 heartbeater.cc:464] Registering TS with master...
I20260812 00:31:44.212893 23004 heartbeater.cc:511] Master 127.29.190.190:46283 requested a full tablet report, sending...
I20260812 00:31:44.215392 22717 ts_manager.cc:194] Registered new tserver with Master: ed09251fd6e14a52aa9b6f24d84fda4b (127.29.190.129:35923)
I20260812 00:31:44.216933 22717 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:44287
W20260812 00:31:44.549906 23008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:44.550282 23008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:44.550464 23008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:44.558198 23008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:44.558364 23008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:44.558555 23008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:31:44.569221 23008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:44123
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=44335
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:44.570593 23008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:44.571990 23008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:44.585637 23019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:44.585685 23026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:44.585731 23021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:44.592126 23008 server_base.cc:1034] running on GCE node
I20260812 00:31:44.592864 23008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:44.593876 23008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:44.595115 23008 hybrid_clock.cc:648] HybridClock initialized: now 1786494704595067 us; error 45 us; skew 500 ppm
I20260812 00:31:44.595487 23008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:44 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494704, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:44.598656 23008 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:31:44.600273 23008 webserver.cc:460] Webserver started at http://127.29.190.130:44335/ using document root <none> and password file <none>
I20260812 00:31:44.600989 23008 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:44.601161 23008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:44.606652 23008 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:31:44.609516 23041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:44.611044 23008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:31:44.611219 23008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "d3756a3615ad4a8cb2a53532a39ad043"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "3f600c8399043a99405ad74d1c305b04"
server_key_iv: "3cad9a85584cbe3dd611c686e7390197"
server_key_version: "encryptionkey@0"
I20260812 00:31:44.612422 23008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:44.628829 23008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:44.633481 23008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:44.633786 23008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:44.634884 23008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:44.636524 23008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:31:44.636658 23008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:44.636821 23008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:44.636907 23008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:44.675536 23008 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:44123
I20260812 00:31:44.675655 23219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:44123 every 8 connection(s)
I20260812 00:31:44.677155 23008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:31:44.678689 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 23008
I20260812 00:31:44.679649 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:35289
--local_ip_for_outbound_sockets=127.29.190.131
--tserver_master_addrs=127.29.190.190:46283
--webserver_port=36249
--webserver_interface=127.29.190.131
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 00:31:44 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494704, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:31:44.706832 23006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:44.680523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:41977 (local address 127.29.190.190:46283)
0812 00:31:44.680791 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:44.680801 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:44.682186 (+ 1385us) server_negotiation.cc:407] Connection header received
0812 00:31:44.686078 (+ 3892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:44.686088 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:44.686229 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:44.686318 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:44.689295 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:44.690548 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:44.693219 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:44.694098 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:44.694271 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:44.698580 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:44.698590 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:44.698598 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:44.698651 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:44.702833 (+ 4182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:44.703832 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:44.703842 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:44.703848 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:44.704030 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:44.704524 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:44.704532 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:44.704538 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:44.704988 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:44.705161 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:44.705982 (+ 821us) server_negotiation.cc:299] Negotiation successful
0812 00:31:44.706291 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 00:31:44.707508 23225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:44.681056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:41977)
0812 00:31:44.681981 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:44.682036 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:44.685638 (+ 3602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:44.687014 (+ 1376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:44.687030 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:44.688051 (+ 1021us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:31:44.689006 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:44.689040 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:44.690814 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:44.690822 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:44.693018 (+ 2196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:44.693034 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:44.694381 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:44.694389 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:44.694648 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:44.695544 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:31:44.695570 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:31:44.698256 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:31:44.703032 (+ 4776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:44.703040 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:44.703082 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:44.703674 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:44.704153 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:44.704157 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:44.704159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:44.704359 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:44.705143 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:31:44.705151 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:31:44.705557 (+ 406us) client_negotiation.cc:769] Sending connection context
0812 00:31:44.705804 (+ 247us) client_negotiation.cc:240] Negotiation successful
0812 00:31:44.706248 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":327,"threads_started":1}
I20260812 00:31:44.709182 23223 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46283
I20260812 00:31:44.709537 23223 heartbeater.cc:464] Registering TS with master...
I20260812 00:31:44.710305 23223 heartbeater.cc:511] Master 127.29.190.190:46283 requested a full tablet report, sending...
I20260812 00:31:44.712035 22717 ts_manager.cc:194] Registered new tserver with Master: d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123)
I20260812 00:31:44.712872 22717 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:41977
W20260812 00:31:45.043764 23226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:31:45.044094 23226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:31:45.044265 23226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:31:45.051658 23226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:31:45.051829 23226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:31:45.052023 23226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:31:45.062219 23226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:35289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=36249
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:31:45.063650 23226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:31:45.065110 23226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:31:45.079069 23232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:45.079114 23233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:31:45.079187 23240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:31:45.080076 23226 server_base.cc:1034] running on GCE node
I20260812 00:31:45.080727 23226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:31:45.081728 23226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:31:45.083020 23226 hybrid_clock.cc:648] HybridClock initialized: now 1786494705082951 us; error 56 us; skew 500 ppm
I20260812 00:31:45.083500 23226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:31:45 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494705, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:31:45.087082 23226 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:31:45.088923 23226 webserver.cc:460] Webserver started at http://127.29.190.131:36249/ using document root <none> and password file <none>
I20260812 00:31:45.089705 23226 fs_manager.cc:359] Metadata directory not provided
I20260812 00:31:45.089874 23226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:31:45.095672 23226 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 00:31:45.098636 23250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:45.100159 23226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:31:45.100345 23226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "a49308d8407e4e63a5e74d9ded53dcc7"
format_stamp: "Formatted at 2026-08-12 00:31:22 on dist-test-slave-c12x"
server_key: "a29e8210b89a393160abce9b1a5d4e51"
server_key_iv: "9da2ee1be6f0adefcbabd1b8d50b4dca"
server_key_version: "encryptionkey@0"
I20260812 00:31:45.101406 23226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:31:45.116207 23226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:31:45.120730 23226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:31:45.121013 23226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:31:45.122017 23226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:31:45.123380 23226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:31:45.123556 23226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:45.123708 23226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:31:45.123798 23226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:31:45.160120 23226 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:35289
I20260812 00:31:45.160181 23429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:35289 every 8 connection(s)
I20260812 00:31:45.161711 23226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:31:45.167282 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 23226
Aug 12 00:31:45 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494705, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:31:45.186124 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.168395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57214 (local address 127.29.190.190:46283)
0812 00:31:45.168911 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.168919 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.169274 (+ 355us) server_negotiation.cc:407] Connection header received
0812 00:31:45.169474 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.169486 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.169543 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.169656 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:45.171756 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.172475 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.174213 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.174768 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.174890 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.178361 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:45.178368 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:45.178373 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:45.178411 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:45.182674 (+ 4263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.183538 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.183543 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.183546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.183687 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.184152 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.184157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.184159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.184497 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:45.184715 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.185233 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.185583 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":383,"spinlock_wait_cycles":4992,"thread_start_us":282,"threads_started":1}
I20260812 00:31:45.186147 23006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.164549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:52055 (local address 127.29.190.190:46283)
0812 00:31:45.164799 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.164807 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.165942 (+ 1135us) server_negotiation.cc:407] Connection header received
0812 00:31:45.167893 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.167900 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.168010 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.168102 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:45.170037 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.171276 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.172982 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.173614 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.173731 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.178482 (+ 4751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:45.178487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:45.178491 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:45.178536 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:45.182004 (+ 3468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.182904 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.182909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.182912 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.183064 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.183719 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.183725 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.183728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.184173 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:45.184338 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.185233 (+ 895us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.185720 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":245,"server-negotiator.queue_time_us":99,"spinlock_wait_cycles":1920}
I20260812 00:31:45.186866 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.165035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:52055)
0812 00:31:45.165769 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.165816 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:45.167601 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:45.168417 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:45.168428 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:45.169268 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:31:45.169866 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.169884 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.171518 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.171522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.172844 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.172857 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.173827 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.173832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.174168 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.174985 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:31:45.175017 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:31:45.178242 (+ 3225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:31:45.182168 (+ 3926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:45.182178 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:45.182195 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:45.182788 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:45.183198 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:31:45.183205 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:31:45.183209 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:31:45.183499 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:31:45.184310 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:31:45.184318 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:31:45.184746 (+ 428us) client_negotiation.cc:769] Sending connection context
0812 00:31:45.185062 (+ 316us) client_negotiation.cc:240] Negotiation successful
0812 00:31:45.185625 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":287,"threads_started":1}
I20260812 00:31:45.188369 23430 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46283
I20260812 00:31:45.188717 23430 heartbeater.cc:464] Registering TS with master...
I20260812 00:31:45.189602 23430 heartbeater.cc:511] Master 127.29.190.190:46283 requested a full tablet report, sending...
I20260812 00:31:45.191184 22716 ts_manager.cc:194] Registered new tserver with Master: a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
I20260812 00:31:45.192209 22716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:52055
I20260812 00:31:45.201694 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:31:45.208660 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.202672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57220 (local address 127.29.190.190:46283)
0812 00:31:45.202923 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.202933 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.203361 (+ 428us) server_negotiation.cc:407] Connection header received
0812 00:31:45.203640 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.203643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.203780 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.203913 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:31:45.204384 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.205093 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.206822 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.207240 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.207337 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.207878 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:31:45.208158 (+ 280us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 00:31:45.208431 (+ 273us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57220: token expired
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 00:31:45.208827 23435 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57220: token expired
W20260812 00:31:45.209486 22587 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.29.190.190:46283)
I20260812 00:31:45.220734 23004 heartbeater.cc:503] Master 127.29.190.190:46283 was elected leader, sending a full tablet report...
I20260812 00:31:45.223511 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.209974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57230 (local address 127.29.190.190:46283)
0812 00:31:45.210127 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.210131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.210247 (+ 116us) server_negotiation.cc:407] Connection header received
0812 00:31:45.210345 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.210349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.210439 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.210516 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:45.211954 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.212670 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.213958 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.214366 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.214465 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.217234 (+ 2769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:45.217238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:45.217242 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:45.217292 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:45.220222 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.221171 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.221176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.221179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.221357 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.221796 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.221803 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.221807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.222172 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:45.222442 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.222888 (+ 446us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.223118 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:31:45.226934 22716 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:31:45.234609 22716 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:31:45.271695 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.247476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37698 (local address 127.29.190.129:35923)
0812 00:31:45.263151 (+ 15675us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.263160 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.263188 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:31:45.263289 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.263299 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.263550 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.263749 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:45.264561 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.266177 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.269147 (+ 2970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.270414 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.270653 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.270839 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.271120 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.271289 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15492,"thread_start_us":15328,"threads_started":1}
I20260812 00:31:45.271801 23451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.247221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37698)
0812 00:31:45.258303 (+ 11082us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.258373 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:45.258632 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:45.263871 (+ 5239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:45.263879 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:45.263913 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:45.264342 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.264358 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.266323 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.266329 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.268431 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.268447 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.270651 (+ 2204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.270657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.270861 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.270915 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 00:31:45.271071 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 00:31:45.271293 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10700,"mutex_wait_us":150,"thread_start_us":14485,"threads_started":1}
I20260812 00:31:45.272500 23445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.247542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:44123 (local address 127.0.0.1:33262)
0812 00:31:45.261501 (+ 13959us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.261522 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:45.261642 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:45.263454 (+ 1812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:45.263465 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:45.263502 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:45.264047 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.264064 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.266385 (+ 2321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.266389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.269147 (+ 2758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.269165 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.271313 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.271326 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.271667 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.271804 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 00:31:45.271895 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 00:31:45.272045 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13808,"mutex_wait_us":247,"thread_start_us":11330,"threads_started":1}
I20260812 00:31:45.272763 23453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.261784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:35289 (local address 127.0.0.1:33390)
0812 00:31:45.263359 (+ 1575us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.263378 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:45.263534 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:45.264249 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:45.264256 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:45.264293 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:45.264683 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.264691 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.266529 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.266536 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.269147 (+ 2611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.269165 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.271343 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.271349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.271672 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.271957 (+ 285us) client_negotiation.cc:769] Sending connection context
0812 00:31:45.272029 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 00:31:45.272135 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1429,"mutex_wait_us":406,"spinlock_wait_cycles":6400,"thread_start_us":1666,"threads_started":1}
I20260812 00:31:45.273346 23448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.247608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33262 (local address 127.29.190.130:44123)
0812 00:31:45.262699 (+ 15091us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.262710 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.262746 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:31:45.262859 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.262867 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.263161 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.263375 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:45.264506 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.266173 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.269346 (+ 3173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.270798 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.270949 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.271121 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.272818 (+ 1697us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.273015 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14917,"thread_start_us":14779,"threads_started":1}
I20260812 00:31:45.273854 23452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.260320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33390 (local address 127.29.190.131:35289)
0812 00:31:45.261901 (+ 1581us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.261915 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.263683 (+ 1768us) server_negotiation.cc:407] Connection header received
0812 00:31:45.263792 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.263800 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.264017 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.264233 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:45.264854 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.266390 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.269346 (+ 2956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.270791 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.270980 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.271121 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.272523 (+ 1402us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.273244 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1338,"thread_start_us":1098,"threads_started":1}
I20260812 00:31:45.276842 23329 tablet_service.cc:1467] Processing CreateTablet for tablet b7f292e0be2a4d34b76e2975e78f8146 (DEFAULT_TABLE table=test-table [id=77c6966905d84ca6a5dae52698c3fd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:31:45.276968 23118 tablet_service.cc:1467] Processing CreateTablet for tablet b7f292e0be2a4d34b76e2975e78f8146 (DEFAULT_TABLE table=test-table [id=77c6966905d84ca6a5dae52698c3fd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:31:45.276855 22901 tablet_service.cc:1467] Processing CreateTablet for tablet b7f292e0be2a4d34b76e2975e78f8146 (DEFAULT_TABLE table=test-table [id=77c6966905d84ca6a5dae52698c3fd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:31:45.278180 23329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7f292e0be2a4d34b76e2975e78f8146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:31:45.278228 23118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7f292e0be2a4d34b76e2975e78f8146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:31:45.278247 22901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7f292e0be2a4d34b76e2975e78f8146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:31:45.290783 23454 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Bootstrap starting.
I20260812 00:31:45.293825 23455 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Bootstrap starting.
I20260812 00:31:45.294543 23454 tablet_bootstrap.cc:654] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Neither blocks nor log segments found. Creating new log.
I20260812 00:31:45.294900 23456 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Bootstrap starting.
I20260812 00:31:45.296420 23454 log.cc:824] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:45.298099 23456 tablet_bootstrap.cc:654] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Neither blocks nor log segments found. Creating new log.
I20260812 00:31:45.298283 23455 tablet_bootstrap.cc:654] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Neither blocks nor log segments found. Creating new log.
I20260812 00:31:45.299158 23456 log.cc:824] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:45.299803 23455 log.cc:824] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Log is configured to *not* fsync() on all Append() calls
I20260812 00:31:45.302311 23454 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: No bootstrap required, opened a new log
I20260812 00:31:45.302486 23456 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: No bootstrap required, opened a new log
I20260812 00:31:45.302668 23455 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: No bootstrap required, opened a new log
I20260812 00:31:45.302650 23454 ts_tablet_manager.cc:1397] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260812 00:31:45.302781 23456 ts_tablet_manager.cc:1397] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 00:31:45.302922 23455 ts_tablet_manager.cc:1397] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260812 00:31:45.311419 23456 raft_consensus.cc:348] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.311976 23456 raft_consensus.cc:374] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:31:45.312090 23456 raft_consensus.cc:729] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed09251fd6e14a52aa9b6f24d84fda4b, State: Initialized, Role: FOLLOWER
I20260812 00:31:45.312779 23456 consensus_queue.cc:260] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.313737 23454 raft_consensus.cc:348] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.313750 23455 raft_consensus.cc:348] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.314188 23455 raft_consensus.cc:374] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:31:45.314188 23454 raft_consensus.cc:374] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:31:45.314294 23454 raft_consensus.cc:729] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a49308d8407e4e63a5e74d9ded53dcc7, State: Initialized, Role: FOLLOWER
I20260812 00:31:45.314294 23455 raft_consensus.cc:729] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3756a3615ad4a8cb2a53532a39ad043, State: Initialized, Role: FOLLOWER
I20260812 00:31:45.314922 23454 consensus_queue.cc:260] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.314924 23455 consensus_queue.cc:260] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.317468 23456 ts_tablet_manager.cc:1428] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
I20260812 00:31:45.322409 23223 heartbeater.cc:503] Master 127.29.190.190:46283 was elected leader, sending a full tablet report...
I20260812 00:31:45.323910 23455 ts_tablet_manager.cc:1428] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Time spent starting tablet: real 0.021s user 0.006s sys 0.016s
I20260812 00:31:45.325047 23430 heartbeater.cc:503] Master 127.29.190.190:46283 was elected leader, sending a full tablet report...
I20260812 00:31:45.325672 23454 ts_tablet_manager.cc:1428] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Time spent starting tablet: real 0.023s user 0.015s sys 0.008s
W20260812 00:31:45.413465 23431 tablet.cc:2369] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:31:45.429526 23224 tablet.cc:2369] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:31:45.431691 23005 tablet.cc:2369] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:31:45.467015 23464 raft_consensus.cc:482] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:31:45.467325 23464 raft_consensus.cc:504] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.469290 23464 leader_election.cc:288] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed09251fd6e14a52aa9b6f24d84fda4b (127.29.190.129:35923), a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
I20260812 00:31:45.476866 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.469699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:60631 (local address 127.29.190.129:35923)
0812 00:31:45.469976 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.469986 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.471072 (+ 1086us) server_negotiation.cc:407] Connection header received
0812 00:31:45.471266 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.471270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.471402 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.471534 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:45.472213 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.472937 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.474835 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.475743 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.475871 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.475929 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.476469 (+ 540us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.476605 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:31:45.476962 23467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.469626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.29.190.130:60631)
0812 00:31:45.470955 (+ 1329us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.470975 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:45.471126 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:45.471555 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:45.471564 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:45.471604 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:45.472028 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.472042 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.473073 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.473081 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.474660 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.474674 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.475991 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.476001 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.476222 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.476262 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:31:45.476393 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 00:31:45.476532 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1224,"thread_start_us":559,"threads_started":1}
I20260812 00:31:45.477164 23452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.469962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:58239 (local address 127.29.190.131:35289)
0812 00:31:45.470217 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.470226 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.470894 (+ 668us) server_negotiation.cc:407] Connection header received
0812 00:31:45.471206 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.471211 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.471295 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.471366 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:31:45.472081 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.472862 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.475000 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.476101 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.476287 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.476384 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.476731 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.476870 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 00:31:45.477437 23469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.469590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:35289 (local address 127.29.190.130:58239)
0812 00:31:45.470759 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.470779 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:31:45.470988 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:31:45.471457 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:31:45.471465 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:31:45.471498 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:31:45.471905 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.471917 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.473017 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.473026 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.474728 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:31:45.474770 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.476326 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.476331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:31:45.476535 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.476569 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:31:45.476664 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 00:31:45.476789 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"mutex_wait_us":1,"thread_start_us":1057,"threads_started":1}
I20260812 00:31:45.478338 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7f292e0be2a4d34b76e2975e78f8146" candidate_uuid: "d3756a3615ad4a8cb2a53532a39ad043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" is_pre_election: true
I20260812 00:31:45.478506 23366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7f292e0be2a4d34b76e2975e78f8146" candidate_uuid: "d3756a3615ad4a8cb2a53532a39ad043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" is_pre_election: true
I20260812 00:31:45.478943 22934 raft_consensus.cc:2454] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3756a3615ad4a8cb2a53532a39ad043 in term 0.
I20260812 00:31:45.479055 23366 raft_consensus.cc:2454] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3756a3615ad4a8cb2a53532a39ad043 in term 0.
I20260812 00:31:45.479755 23044 leader_election.cc:302] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a49308d8407e4e63a5e74d9ded53dcc7, d3756a3615ad4a8cb2a53532a39ad043; no voters:
I20260812 00:31:45.480149 23464 raft_consensus.cc:2781] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:31:45.480314 23464 raft_consensus.cc:482] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:31:45.480479 23464 raft_consensus.cc:3037] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:45.482847 23464 raft_consensus.cc:504] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.483667 23464 leader_election.cc:288] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [CANDIDATE]: Term 1 election: Requested vote from peers ed09251fd6e14a52aa9b6f24d84fda4b (127.29.190.129:35923), a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
I20260812 00:31:45.484193 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7f292e0be2a4d34b76e2975e78f8146" candidate_uuid: "d3756a3615ad4a8cb2a53532a39ad043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b"
I20260812 00:31:45.484249 23366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7f292e0be2a4d34b76e2975e78f8146" candidate_uuid: "d3756a3615ad4a8cb2a53532a39ad043" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a49308d8407e4e63a5e74d9ded53dcc7"
I20260812 00:31:45.484419 22934 raft_consensus.cc:3037] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:45.484539 23366 raft_consensus.cc:3037] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:31:45.486811 22934 raft_consensus.cc:2454] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3756a3615ad4a8cb2a53532a39ad043 in term 1.
I20260812 00:31:45.486929 23366 raft_consensus.cc:2454] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3756a3615ad4a8cb2a53532a39ad043 in term 1.
I20260812 00:31:45.487365 23043 leader_election.cc:302] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3756a3615ad4a8cb2a53532a39ad043, ed09251fd6e14a52aa9b6f24d84fda4b; no voters:
I20260812 00:31:45.487787 23464 raft_consensus.cc:2781] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:31:45.488291 23464 raft_consensus.cc:686] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 1 LEADER]: Becoming Leader. State: Replica: d3756a3615ad4a8cb2a53532a39ad043, State: Running, Role: LEADER
I20260812 00:31:45.488830 23464 consensus_queue.cc:237] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:31:45.494321 22717 catalog_manager.cc:5495] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "d3756a3615ad4a8cb2a53532a39ad043" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } health_report { overall_health: UNKNOWN } } }
I20260812 00:31:45.519138 23448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.512730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33278 (local address 127.29.190.130:44123)
0812 00:31:45.512937 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.512942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.512962 (+ 20us) server_negotiation.cc:407] Connection header received
0812 00:31:45.513085 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.513089 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.513171 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.513307 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:31:45.513814 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.514720 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.516564 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.516984 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.517160 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.517880 (+ 720us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:31:45.518523 (+ 643us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:31:45.518660 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.518814 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.518895 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:31:45.528640 23366 raft_consensus.cc:1261] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 1 FOLLOWER]: Refusing update from remote peer d3756a3615ad4a8cb2a53532a39ad043: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:31:45.528867 22934 raft_consensus.cc:1261] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Refusing update from remote peer d3756a3615ad4a8cb2a53532a39ad043: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:31:45.529953 23471 consensus_queue.cc:1035] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:31:45.530433 23464 consensus_queue.cc:1035] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:31:45.543284 23476 mvcc.cc:205] Tried to move back new op lower bound from 7317482313833074688 to 7317482313686876160. Current Snapshot: MvccSnapshot[applied={T|T < 7317482313833074688}]
I20260812 00:31:45.568202 22716 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:31:45.568531 22716 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:31:45.572465 22716 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Sending DeleteTablet for 3 replicas of tablet b7f292e0be2a4d34b76e2975e78f8146
I20260812 00:31:45.573843 22901 tablet_service.cc:1514] Processing DeleteTablet for tablet b7f292e0be2a4d34b76e2975e78f8146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:45 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:37698
I20260812 00:31:45.573989 23329 tablet_service.cc:1514] Processing DeleteTablet for tablet b7f292e0be2a4d34b76e2975e78f8146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:45 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:33390
I20260812 00:31:45.574386 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 22774
I20260812 00:31:45.575125 23118 tablet_service.cc:1514] Processing DeleteTablet for tablet b7f292e0be2a4d34b76e2975e78f8146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:31:45 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:33262
I20260812 00:31:45.599982 23492 tablet_replica.cc:330] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: stopping tablet replica
I20260812 00:31:45.600679 23492 raft_consensus.cc:2229] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:31:45.601377 23492 raft_consensus.cc:2258] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:45.603912 23492 ts_tablet_manager.cc:1905] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:45.606439 23490 tablet_replica.cc:330] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: stopping tablet replica
I20260812 00:31:45.603368 23493 tablet_replica.cc:330] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: stopping tablet replica
I20260812 00:31:45.607666 23493 raft_consensus.cc:2229] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:31:45.608332 23493 raft_consensus.cc:2258] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:45.609129 23490 raft_consensus.cc:2229] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:31:45.609748 23490 raft_consensus.cc:2258] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:31:45.607097 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.577343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37700 (local address 127.29.190.129:35923)
0812 00:31:45.577722 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.577732 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.577761 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:31:45.577844 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.577852 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.577968 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.578113 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:45.582215 (+ 4102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.584102 (+ 1887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.587352 (+ 3250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.588571 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.588738 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.594547 (+ 5809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:45.594579 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:45.594611 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:45.594685 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:45.600949 (+ 6264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.602298 (+ 1349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.602308 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.602312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.602538 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.604373 (+ 1835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.604396 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.604402 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.605074 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:45.605503 (+ 429us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.606428 (+ 925us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.606694 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
I20260812 00:31:45.610949 22992 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:45.612169 23493 ts_tablet_manager.cc:1905] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:31:45.612728 23492 ts_tablet_manager.cc:1918] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:45.612903 23492 log.cc:1196] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/b7f292e0be2a4d34b76e2975e78f8146
I20260812 00:31:45.613610 23492 ts_tablet_manager.cc:1939] T b7f292e0be2a4d34b76e2975e78f8146 P a49308d8407e4e63a5e74d9ded53dcc7: Deleting consensus metadata
I20260812 00:31:45.615725 22686 catalog_manager.cc:4841] TS a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289): tablet b7f292e0be2a4d34b76e2975e78f8146 (table test-table [id=77c6966905d84ca6a5dae52698c3fd24]) successfully deleted
I20260812 00:31:45.627168 23493 ts_tablet_manager.cc:1918] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:31:45.627764 23493 log.cc:1196] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/b7f292e0be2a4d34b76e2975e78f8146
I20260812 00:31:45.628613 23493 ts_tablet_manager.cc:1939] T b7f292e0be2a4d34b76e2975e78f8146 P d3756a3615ad4a8cb2a53532a39ad043: Deleting consensus metadata
I20260812 00:31:45.631373 22686 catalog_manager.cc:4841] TS d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123): tablet b7f292e0be2a4d34b76e2975e78f8146 (table test-table [id=77c6966905d84ca6a5dae52698c3fd24]) successfully deleted
I20260812 00:31:45.776633 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 22774
W20260812 00:31:45.802345 22685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.190.129:35923 (error 108)
I20260812 00:31:45.802726 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 23008
I20260812 00:31:45.805287 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.804132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37704)
0812 00:31:45.804903 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.805051 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":530,"threads_started":1}
W20260812 00:31:45.805657 22685 catalog_manager.cc:4584] TS ed09251fd6e14a52aa9b6f24d84fda4b (127.29.190.129:35923): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b7f292e0be2a4d34b76e2975e78f8146: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
I20260812 00:31:45.824952 23448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.804142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33286 (local address 127.29.190.130:44123)
0812 00:31:45.804403 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.804412 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.804438 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:31:45.804525 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.804533 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.804638 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.804748 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:45.806646 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.808008 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.809405 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.810110 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.810257 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.817236 (+ 6979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:45.817250 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:45.817271 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:45.817331 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:45.821749 (+ 4418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.822469 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.822480 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.822484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.822674 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.823056 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.823062 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.823066 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.823631 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:45.823991 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.824172 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.824432 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:31:45.825801 23211 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:45.859701 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.859084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37718)
0812 00:31:45.859333 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.859517 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260812 00:31:45.860916 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.860509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37720)
0812 00:31:45.860685 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.860769 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 00:31:45.921958 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.921377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37728)
0812 00:31:45.921662 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.921795 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260812 00:31:45.923117 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.922730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37732)
0812 00:31:45.922895 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:45.922981 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 00:31:45.944591 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 23008
I20260812 00:31:45.973884 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 23226
I20260812 00:31:45.989686 23452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:45.974786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.29.190.131:35289)
0812 00:31:45.974973 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 00:31:45.974978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:31:45.974996 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:31:45.975124 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:31:45.975128 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:31:45.975196 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:31:45.975287 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:31:45.976968 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.977801 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.979258 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:31:45.980004 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:31:45.980129 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:31:45.983164 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:31:45.983188 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:31:45.983209 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:31:45.983306 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:31:45.986366 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.987259 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.987268 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.987271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.987573 (+ 302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:31:45.988017 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:31:45.988021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:31:45.988023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:31:45.988474 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:31:45.988721 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 00:31:45.989165 (+ 444us) server_negotiation.cc:299] Negotiation successful
0812 00:31:45.989361 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:31:45.990463 23425 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:46.004359 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:46.003844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37746)
0812 00:31:46.004082 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:46.004191 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 00:31:46.005528 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:46.005120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37756)
0812 00:31:46.005329 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:46.005397 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 00:31:46.083181 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 23226
I20260812 00:31:46.106487 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 22659
I20260812 00:31:46.107872 22762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:31:46.224475 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:31:46.223874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35923 (local address 127.0.0.1:37760)
0812 00:31:46.224147 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 00:31:46.224284 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 00:31:46.224498 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 22659
I20260812 00:32:06.253037 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46283
--webserver_interface=127.29.190.190
--webserver_port=37019
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:06.624678 23504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:06.624980 23504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:06.625144 23504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:06.632858 23504 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 00:32:06.632984 23504 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 00:32:06.633068 23504 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 00:32:06.633169 23504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:06.633253 23504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:06.633359 23504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:06.633450 23504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:06.633544 23504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:06.644826 23504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=37019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:06.646265 23504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:06.647778 23504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:06.661056 23511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:06.661008 23515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:06.661103 23512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:06.662317 23504 server_base.cc:1034] running on GCE node
I20260812 00:32:06.663169 23504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:06.664762 23504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:06.665988 23504 hybrid_clock.cc:648] HybridClock initialized: now 1786494726665931 us; error 36 us; skew 500 ppm
I20260812 00:32:06.666355 23504 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:06 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494726, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:06.669780 23504 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:32:06.671753 23504 webserver.cc:460] Webserver started at http://127.29.190.190:37019/ using document root <none> and password file <none>
I20260812 00:32:06.672585 23504 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:06.672717 23504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:06.678680 23504 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260812 00:32:06.681918 23526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:06.683672 23504 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:32:06.683859 23504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6"
format_stamp: "Formatted at 2026-08-12 00:31:20 on dist-test-slave-c12x"
server_key: "c226ba65e7ffa50994e9d23ce75a9152"
server_key_iv: "86060d2f91239fa3eb5ed4cddeecde60"
server_key_version: "encryptionkey@0"
I20260812 00:32:06.684864 23504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:06.699065 23504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:06.704107 23504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:06.704463 23504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:06.724644 23504 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46283
I20260812 00:32:06.724691 23604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46283 every 8 connection(s)
I20260812 00:32:06.726223 23504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:06.733191 23605 sys_catalog.cc:263] Verifying existing consensus state
I20260812 00:32:06.736148 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 23504
I20260812 00:32:06.737066 23605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Bootstrap starting.
I20260812 00:32:06.737298 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:35923
--local_ip_for_outbound_sockets=127.29.190.129
--tserver_master_addrs=127.29.190.190:46283
--webserver_port=35269
--webserver_interface=127.29.190.129
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:32:06.763089 23605 log.cc:824] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:06.780517 23605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:32:06.781165 23605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Bootstrap complete.
I20260812 00:32:06.791532 23605 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:32:06.792505 23605 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9dcfa3c4ce44b4f840a4ccba73320a6, State: Initialized, Role: FOLLOWER
I20260812 00:32:06.793237 23605 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:32:06.793485 23605 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:06.793617 23605 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:06.793807 23605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 2 FOLLOWER]: Advancing to term 3
I20260812 00:32:06.797847 23605 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:32:06.798420 23605 leader_election.cc:302] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9dcfa3c4ce44b4f840a4ccba73320a6; no voters:
I20260812 00:32:06.799158 23605 leader_election.cc:288] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 00:32:06.799310 23611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 00:32:06.800678 23611 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [term 3 LEADER]: Becoming Leader. State: Replica: c9dcfa3c4ce44b4f840a4ccba73320a6, State: Running, Role: LEADER
I20260812 00:32:06.801393 23611 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } }
I20260812 00:32:06.801618 23605 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:06.804272 23613 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } } }
I20260812 00:32:06.804718 23613 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:06.807088 23614 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9dcfa3c4ce44b4f840a4ccba73320a6. Latest consensus state: current_term: 3 leader_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9dcfa3c4ce44b4f840a4ccba73320a6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46283 } } }
I20260812 00:32:06.807554 23614 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:06.809453 23619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:06.824855 23619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:06.827159 23619 catalog_manager.cc:1259] Loaded cluster ID: bca6e7e257f8495ca51e49d997498406
I20260812 00:32:06.827386 23619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:06.833832 23619 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:06.836390 23619 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Loaded TSK: 0
I20260812 00:32:06.836726 23619 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c9dcfa3c4ce44b4f840a4ccba73320a6: Loaded TSK: 1
F20260812 00:32:06.838583 23619 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
I20260812 00:32:06.839459 23635 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
*** Check failure stack trace: ***
@ 0x7f1f194a19ad google::LogMessage::Fail() at ??:0
@ 0x7f1f194a488a google::LogMessage::SendToLog() at ??:0
@ 0x7f1f194a14de google::LogMessage::Flush() at ??:0
@ 0x7f1f194a2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1f1d2057d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1f1d1f473e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1f2eed41c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1f2eed3783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1f2ef5f2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f1f2ef5f0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f1f2efa95e9 std::function<>::operator()() at ??:0
@ 0x7f1f2eed7cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f1f2eed5c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1f2ef5d610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f1f2ef5d439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f1f1c0ed345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1f1c0f091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f1f1c0f0799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f1f1c0cbeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1f1f3a56db start_thread at ??:0
@ 0x7f1f1833b61f clone at ??:0
W20260812 00:32:07.184391 23608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:07.184675 23608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:07.184828 23608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:07.192322 23608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:07.192445 23608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:07.192653 23608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:32:07.202759 23608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:35923
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=35269
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:07.204249 23608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:07.205662 23608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:07.219422 23677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:07.219509 23679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:07.219483 23676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:07.220427 23608 server_base.cc:1034] running on GCE node
I20260812 00:32:07.220994 23608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:07.221927 23608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:07.223136 23608 hybrid_clock.cc:648] HybridClock initialized: now 1786494727223085 us; error 46 us; skew 500 ppm
I20260812 00:32:07.223515 23608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:07 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:07.227052 23608 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:32:07.229279 23608 webserver.cc:460] Webserver started at http://127.29.190.129:35269/ using document root <none> and password file <none>
I20260812 00:32:07.229949 23608 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:07.230108 23608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:07.235841 23608 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:32:07.238865 23691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:07.240370 23608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:32:07.240512 23608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "ed09251fd6e14a52aa9b6f24d84fda4b"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "a81c3a834ef89721553424caf656ff81"
server_key_iv: "8e6a2f37fb6563db3a8dfe84336cb046"
server_key_version: "encryptionkey@0"
I20260812 00:32:07.241446 23608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:07.274534 23608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:07.279114 23608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:07.279353 23608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:07.280411 23608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:07.282413 23699 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 00:32:07.288470 23608 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 00:32:07.288630 23608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260812 00:32:07.288780 23608 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 00:32:07.292140 23608 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 00:32:07.292249 23608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.003s sys 0.000s
I20260812 00:32:07.292639 23699 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Bootstrap starting.
I20260812 00:32:07.301642 23699 log.cc:824] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:07.316092 23699 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 00:32:07.317124 23699 tablet_bootstrap.cc:492] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Bootstrap complete.
I20260812 00:32:07.317608 23699 ts_tablet_manager.cc:1397] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Time spent bootstrapping tablet: real 0.025s user 0.019s sys 0.004s
I20260812 00:32:07.326539 23699 raft_consensus.cc:348] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:32:07.328176 23699 raft_consensus.cc:729] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed09251fd6e14a52aa9b6f24d84fda4b, State: Initialized, Role: FOLLOWER
I20260812 00:32:07.328887 23699 consensus_queue.cc:260] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:32:07.330572 23699 ts_tablet_manager.cc:1428] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260812 00:32:07.344369 23608 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:35923
I20260812 00:32:07.344413 23887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:35923 every 8 connection(s)
I20260812 00:32:07.345892 23608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:32:07.350630 23893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:07.348733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:40539)
0812 00:32:07.349553 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:07.349789 (+ 236us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":350,"threads_started":1}
W20260812 00:32:07.351284 23889 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:46283 (0 consecutive failures): Network error: Failed to ping master at 127.29.190.190:46283: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
I20260812 00:32:07.352147 23893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:07.351817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:60065)
0812 00:32:07.351959 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:07.352025 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 00:32:07.352752 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 23608
I20260812 00:32:07.353060 23893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:07.352650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:59283)
0812 00:32:07.352822 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:07.352921 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 00:32:07.353294 23889 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:32:07.353508 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:44123
--local_ip_for_outbound_sockets=127.29.190.130
--tserver_master_addrs=127.29.190.190:46283
--webserver_port=44335
--webserver_interface=127.29.190.130
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:07.715873 23895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:07.716188 23895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:07.716396 23895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:07.724056 23895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:07.724180 23895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:07.724406 23895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:32:07.734753 23895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:44123
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=44335
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:07.736284 23895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:07.737742 23895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:07.752087 23904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:07.752146 23907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:07.752170 23905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:07.753189 23895 server_base.cc:1034] running on GCE node
I20260812 00:32:07.753814 23895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:07.754850 23895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:07.756094 23895 hybrid_clock.cc:648] HybridClock initialized: now 1786494727756049 us; error 43 us; skew 500 ppm
I20260812 00:32:07.756420 23895 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:07 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:07.759825 23895 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:32:07.761407 23895 webserver.cc:460] Webserver started at http://127.29.190.130:44335/ using document root <none> and password file <none>
I20260812 00:32:07.762152 23895 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:07.762324 23895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:07.768188 23895 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 00:32:07.771196 23919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:07.772735 23895 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:32:07.772926 23895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "d3756a3615ad4a8cb2a53532a39ad043"
format_stamp: "Formatted at 2026-08-12 00:31:21 on dist-test-slave-c12x"
server_key: "3f600c8399043a99405ad74d1c305b04"
server_key_iv: "3cad9a85584cbe3dd611c686e7390197"
server_key_version: "encryptionkey@0"
I20260812 00:32:07.773978 23895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:07.792616 23895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:07.797259 23895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:07.797570 23895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:07.798667 23895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:07.800185 23895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:07.800319 23895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:07.800455 23895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:07.800546 23895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:07.836508 23895 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:44123
I20260812 00:32:07.836570 24100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:44123 every 8 connection(s)
I20260812 00:32:07.838052 23895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:32:07.843358 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:07.841369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:34335)
0812 00:32:07.842161 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:07.842418 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":319,"threads_started":1}
W20260812 00:32:07.844194 24101 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:46283 (0 consecutive failures): Network error: Failed to ping master at 127.29.190.190:46283: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
I20260812 00:32:07.844723 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 23895
I20260812 00:32:07.845392 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:07.845011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:45339)
0812 00:32:07.845189 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:07.845274 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 00:32:07.845512 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:35289
--local_ip_for_outbound_sockets=127.29.190.131
--tserver_master_addrs=127.29.190.190:46283
--webserver_port=36249
--webserver_interface=127.29.190.131
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:32:07.846407 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:07.846053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:48879)
0812 00:32:07.846207 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:07.846295 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 00:32:07.846686 24101 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 00:32:08.197988 24105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:08.198294 24105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:08.198395 24105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:08.205871 24105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:08.205996 24105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:08.206125 24105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:32:08.216499 24105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:35289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=36249
--tserver_master_addrs=127.29.190.190:46283
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:08.217775 24105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:08.219069 24105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:08.232676 24110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:08.232777 24114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:08.232748 24111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:08.234022 24105 server_base.cc:1034] running on GCE node
I20260812 00:32:08.234663 24105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:08.235707 24105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:08.236944 24105 hybrid_clock.cc:648] HybridClock initialized: now 1786494728236882 us; error 41 us; skew 500 ppm
I20260812 00:32:08.237273 24105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:08 dist-test-slave-c12x krb5kdc[21799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494728, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:08.240705 24105 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:32:08.242290 24105 webserver.cc:460] Webserver started at http://127.29.190.131:36249/ using document root <none> and password file <none>
I20260812 00:32:08.243076 24105 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:08.243235 24105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:08.249533 24105 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 00:32:08.252589 24123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:08.254050 24105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:32:08.254249 24105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "a49308d8407e4e63a5e74d9ded53dcc7"
format_stamp: "Formatted at 2026-08-12 00:31:22 on dist-test-slave-c12x"
server_key: "a29e8210b89a393160abce9b1a5d4e51"
server_key_iv: "9da2ee1be6f0adefcbabd1b8d50b4dca"
server_key_version: "encryptionkey@0"
I20260812 00:32:08.255285 24105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:08.267482 24105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:08.271610 24105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:08.271900 24105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:08.272884 24105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:08.274262 24105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:08.274403 24105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:08.274538 24105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:08.274633 24105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:08.315806 24105 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:35289
I20260812 00:32:08.315923 24298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:35289 every 8 connection(s)
I20260812 00:32:08.318074 24105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:32:08.326586 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 24105
I20260812 00:32:08.324251 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.322040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:33913)
0812 00:32:08.322954 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:08.323206 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":589,"threads_started":1}
W20260812 00:32:08.327791 24299 heartbeater.cc:644] Failed to heartbeat to 127.29.190.190:46283 (0 consecutive failures): Network error: Failed to ping master at 127.29.190.190:46283: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
I20260812 00:32:08.328753 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.328357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:34715)
0812 00:32:08.328520 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:08.328606 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 00:32:08.329746 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.329343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:59583)
0812 00:32:08.329489 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:08.329566 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 00:32:08.330067 24299 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 00:32:08.355136 24307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.353923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:50141)
0812 00:32:08.354530 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:08.354678 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":268,"threads_started":1}
I20260812 00:32:08.831240 24308 raft_consensus.cc:482] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:08.831671 24308 raft_consensus.cc:504] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:32:08.833410 24308 leader_election.cc:288] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123), a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
I20260812 00:32:08.848181 24315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.847165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:34817)
0812 00:32:08.847717 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:08.847852 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":304,"threads_started":1}
Aug 12 00:32:08 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
Aug 12 00:32:08 dist-test-slave-c12x krb5kdc[21799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494727, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:32:08.858623 24307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.833730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:44123 (local address 127.29.190.129:36207)
0812 00:32:08.833921 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:08.833955 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:08.834612 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:08.839605 (+ 4993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:08.839617 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:08.840504 (+ 887us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:08.841374 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:08.841401 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:08.843174 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:08.843178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:08.845065 (+ 1887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:08.845083 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:08.846479 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:08.846513 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:08.846940 (+ 427us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:08.848105 (+ 1165us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:08.848134 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:08.850873 (+ 2739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:08.854840 (+ 3967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:08.854853 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:08.854871 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:08.855527 (+ 656us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:08.855955 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:08.855960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:08.855964 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:08.856149 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:08.856925 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:08.856935 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:08.857330 (+ 395us) client_negotiation.cc:769] Sending connection context
0812 00:32:08.857598 (+ 268us) client_negotiation.cc:240] Negotiation successful
0812 00:32:08.858163 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":108,"spinlock_wait_cycles":31360}
I20260812 00:32:08.858676 24312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.834471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:53019 (local address 127.29.190.131:35289)
0812 00:32:08.835595 (+ 1124us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:08.835617 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:08.836205 (+ 588us) server_negotiation.cc:407] Connection header received
0812 00:32:08.838454 (+ 2249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:08.838467 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:08.838990 (+ 523us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:08.839383 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:08.841801 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:08.843614 (+ 1813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:08.845430 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:08.846384 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:08.846532 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:08.851619 (+ 5087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:08.851628 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:08.851640 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:08.851679 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:08.854737 (+ 3058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:08.855645 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:08.855655 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:08.855663 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:08.855831 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:08.856471 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:08.856481 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:08.856483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:08.857030 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:08.857223 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:08.857820 (+ 597us) server_negotiation.cc:299] Negotiation successful
0812 00:32:08.858179 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":800,"thread_start_us":703,"threads_started":1}
I20260812 00:32:08.858796 24309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.834168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:35289 (local address 127.29.190.129:53019)
0812 00:32:08.836058 (+ 1890us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:08.836085 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:08.836235 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:08.840013 (+ 3778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:08.840017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:08.841255 (+ 1238us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:08.841610 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:08.841624 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:08.843778 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:08.843785 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:08.845304 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:08.845315 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:08.846578 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:08.846584 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:08.846937 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:08.848038 (+ 1101us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:08.848063 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:08.851266 (+ 3203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:08.854885 (+ 3619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:08.854888 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:08.854891 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:08.855504 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:08.856244 (+ 740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:08.856247 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:08.856249 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:08.856355 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:08.857161 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:08.857164 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:08.857313 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 00:32:08.857599 (+ 286us) client_negotiation.cc:240] Negotiation successful
0812 00:32:08.858305 (+ 706us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1752,"mutex_wait_us":321,"thread_start_us":2069,"threads_started":1}
I20260812 00:32:08.858656 24311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:08.834085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:36207 (local address 127.29.190.130:44123)
0812 00:32:08.835968 (+ 1883us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:08.835998 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:08.836044 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:32:08.838534 (+ 2490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:08.838544 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:08.839008 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:08.839379 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:08.841616 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:08.842969 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:08.845229 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:08.846280 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:08.846486 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:08.851276 (+ 4790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:08.851288 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:08.851309 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:08.851365 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:08.854685 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:08.855667 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:08.855673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:08.855679 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:08.855836 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:08.856253 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:08.856256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:08.856258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:08.856778 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:08.856923 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:08.857846 (+ 923us) server_negotiation.cc:299] Negotiation successful
0812 00:32:08.858244 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1671,"thread_start_us":1498,"threads_started":1}
W20260812 00:32:08.861955 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
W20260812 00:32:08.862316 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
I20260812 00:32:08.862466 23693 leader_election.cc:302] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed09251fd6e14a52aa9b6f24d84fda4b; no voters: a49308d8407e4e63a5e74d9ded53dcc7, d3756a3615ad4a8cb2a53532a39ad043
I20260812 00:32:08.862901 24308 raft_consensus.cc:2726] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:32:09.331723 24316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:09.330689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:57797)
0812 00:32:09.331195 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:09.331359 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":252,"threads_started":1}
I20260812 00:32:09.356724 24309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:09.356230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:60187)
0812 00:32:09.356445 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:09.356580 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 00:32:09.850214 24318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:09.849320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:58237)
0812 00:32:09.849896 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:09.849986 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":333,"threads_started":1}
I20260812 00:32:10.333652 24322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:10.332806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:43053)
0812 00:32:10.333354 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:10.333467 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":291,"threads_started":1}
I20260812 00:32:10.358767 24323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:10.357832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:54703)
0812 00:32:10.358441 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:10.358534 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":318,"threads_started":1}
I20260812 00:32:10.772784 24324 raft_consensus.cc:482] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:10.773034 24324 raft_consensus.cc:504] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:32:10.774012 24324 leader_election.cc:288] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123), a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
W20260812 00:32:10.775326 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
W20260812 00:32:10.775681 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
I20260812 00:32:10.775775 23693 leader_election.cc:302] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed09251fd6e14a52aa9b6f24d84fda4b; no voters: a49308d8407e4e63a5e74d9ded53dcc7, d3756a3615ad4a8cb2a53532a39ad043
I20260812 00:32:10.776064 24324 raft_consensus.cc:2726] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:32:10.852030 24326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:10.851189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:35099)
0812 00:32:10.851734 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:10.851825 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":318,"threads_started":1}
I20260812 00:32:11.335618 24327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:11.334728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:44161)
0812 00:32:11.335247 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:11.335338 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":273,"threads_started":1}
I20260812 00:32:11.360934 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:11.360066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:48913)
0812 00:32:11.360659 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:11.360763 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":332,"threads_started":1}
I20260812 00:32:11.854034 24333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:11.853127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:57559)
0812 00:32:11.853711 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:11.853821 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":261,"threads_started":1}
I20260812 00:32:12.337440 24334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:12.336669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:34175)
0812 00:32:12.337172 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:12.337260 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":256,"threads_started":1}
I20260812 00:32:12.362833 24336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:12.362030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:43545)
0812 00:32:12.362561 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:12.362645 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":248,"threads_started":1}
I20260812 00:32:12.722888 24337 raft_consensus.cc:482] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:12.723186 24337 raft_consensus.cc:504] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:32:12.724020 24337 leader_election.cc:288] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123), a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
W20260812 00:32:12.725194 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
W20260812 00:32:12.725461 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
I20260812 00:32:12.725585 23693 leader_election.cc:302] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed09251fd6e14a52aa9b6f24d84fda4b; no voters: a49308d8407e4e63a5e74d9ded53dcc7, d3756a3615ad4a8cb2a53532a39ad043
I20260812 00:32:12.725895 24337 raft_consensus.cc:2726] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:32:12.855895 24341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:12.855088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:32937)
0812 00:32:12.855634 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:12.855724 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":259,"threads_started":1}
I20260812 00:32:13.339258 24342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:13.338547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:57775)
0812 00:32:13.338996 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:13.339082 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":229,"threads_started":1}
I20260812 00:32:13.364702 24343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:13.363950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:54383)
0812 00:32:13.364432 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:13.364535 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":249,"threads_started":1}
I20260812 00:32:13.858103 24344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:13.857187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:32929)
0812 00:32:13.857768 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:13.857899 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":336,"threads_started":1}
I20260812 00:32:14.340956 24346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:14.340188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:36217)
0812 00:32:14.340677 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:14.340763 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":258,"threads_started":1}
I20260812 00:32:14.366395 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:14.365642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:55595)
0812 00:32:14.366121 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:14.366203 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":252,"threads_started":1}
I20260812 00:32:14.557221 24349 raft_consensus.cc:482] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:14.557468 24349 raft_consensus.cc:504] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:32:14.558264 24349 leader_election.cc:288] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123), a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
W20260812 00:32:14.559473 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
W20260812 00:32:14.559782 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
I20260812 00:32:14.559913 23693 leader_election.cc:302] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed09251fd6e14a52aa9b6f24d84fda4b; no voters: a49308d8407e4e63a5e74d9ded53dcc7, d3756a3615ad4a8cb2a53532a39ad043
I20260812 00:32:14.560256 24349 raft_consensus.cc:2726] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:32:14.860320 24350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:14.859242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:38397)
0812 00:32:14.859919 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:14.860036 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":326,"threads_started":1}
I20260812 00:32:15.342991 24351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:15.341996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:44003)
0812 00:32:15.342645 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:15.342747 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":290,"threads_started":1}
I20260812 00:32:15.368248 24352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:15.367368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:50761)
0812 00:32:15.367941 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:15.368064 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":314,"threads_started":1}
I20260812 00:32:15.862098 24353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:15.861230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:34923)
0812 00:32:15.861764 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:15.861878 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":268,"threads_started":1}
I20260812 00:32:16.345225 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:16.344111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:53293)
0812 00:32:16.344795 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:16.344959 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":365,"threads_started":1}
I20260812 00:32:16.369774 24358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:16.369081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:54917)
0812 00:32:16.369503 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:16.369606 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":217,"threads_started":1}
I20260812 00:32:16.864238 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:16.863219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:57477)
0812 00:32:16.863944 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:16.864051 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":398,"threads_started":1}
I20260812 00:32:17.347144 24360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:17.346277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:56711)
0812 00:32:17.346836 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:17.346954 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":266,"threads_started":1}
I20260812 00:32:17.371665 24361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:17.370847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:34065)
0812 00:32:17.371308 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:17.371407 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":241,"threads_started":1}
I20260812 00:32:17.866293 24362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:17.865421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:42701)
0812 00:32:17.866004 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:17.866108 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":349,"threads_started":1}
I20260812 00:32:18.348912 24363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:18.348124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:56303)
0812 00:32:18.348657 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:18.348738 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":311,"threads_started":1}
I20260812 00:32:18.373471 24365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:18.372674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:38641)
0812 00:32:18.373184 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:18.373277 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":292,"threads_started":1}
I20260812 00:32:18.868237 24368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:18.867280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:43229)
0812 00:32:18.867964 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:18.868065 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":445,"threads_started":1}
I20260812 00:32:19.350988 24369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:19.349943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:43459)
0812 00:32:19.350576 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:19.350720 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":289,"threads_started":1}
I20260812 00:32:19.375396 24370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:19.374466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:45761)
0812 00:32:19.375111 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:19.375206 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":354,"threads_started":1}
I20260812 00:32:19.870093 24371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:19.869275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:39883)
0812 00:32:19.869801 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:19.869906 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":278,"threads_started":1}
I20260812 00:32:20.352950 24372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:20.352094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:44073)
0812 00:32:20.352584 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:20.352717 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":258,"threads_started":1}
I20260812 00:32:20.377446 24374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:20.376545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:51559)
0812 00:32:20.377140 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:20.377238 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":271,"threads_started":1}
I20260812 00:32:20.637348 24375 raft_consensus.cc:482] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:20.637692 24375 raft_consensus.cc:504] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed09251fd6e14a52aa9b6f24d84fda4b" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35923 } } peers { permanent_uuid: "d3756a3615ad4a8cb2a53532a39ad043" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 44123 } } peers { permanent_uuid: "a49308d8407e4e63a5e74d9ded53dcc7" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 35289 } }
I20260812 00:32:20.638623 24375 leader_election.cc:288] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123), a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289)
W20260812 00:32:20.639791 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a49308d8407e4e63a5e74d9ded53dcc7 (127.29.190.131:35289): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
W20260812 00:32:20.639998 23693 leader_election.cc:341] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d3756a3615ad4a8cb2a53532a39ad043 (127.29.190.130:44123): Not found: Tablet not found: b7f292e0be2a4d34b76e2975e78f8146
I20260812 00:32:20.640147 23693 leader_election.cc:302] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed09251fd6e14a52aa9b6f24d84fda4b; no voters: a49308d8407e4e63a5e74d9ded53dcc7, d3756a3615ad4a8cb2a53532a39ad043
I20260812 00:32:20.640479 24375 raft_consensus.cc:2726] T b7f292e0be2a4d34b76e2975e78f8146 P ed09251fd6e14a52aa9b6f24d84fda4b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 00:32:20.872159 24376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:20.871308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:58459)
0812 00:32:20.871861 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:20.871986 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":296,"threads_started":1}
I20260812 00:32:21.354800 24379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:21.354026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:46155)
0812 00:32:21.354523 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:21.354623 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":229,"threads_started":1}
I20260812 00:32:21.379601 24380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:21.378679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:42629)
0812 00:32:21.379223 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:21.379321 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":278,"threads_started":1}
I20260812 00:32:21.874104 24381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:21.873214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:56837)
0812 00:32:21.873791 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:21.873887 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":271,"threads_started":1}
I20260812 00:32:22.356621 24383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:22.355842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:35169)
0812 00:32:22.356299 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:22.356396 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":247,"threads_started":1}
I20260812 00:32:22.381855 24385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:22.381050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.129:37611)
0812 00:32:22.381570 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:22.381675 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":271,"threads_started":1}
I20260812 00:32:22.876443 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:22.875582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.130:42565)
0812 00:32:22.876091 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:22.876221 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":248,"threads_started":1}
I20260812 00:32:23.332190 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 23608
I20260812 00:32:23.349169 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:23.333452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52368 (local address 127.29.190.129:35923)
0812 00:32:23.334020 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:23.334028 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:23.334056 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:32:23.334124 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:23.334131 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:23.334349 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:23.334503 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:23.336164 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:23.337224 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:23.338563 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:23.339144 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:23.339260 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:23.342156 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:23.342172 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:23.342188 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:23.342236 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:23.345716 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:23.346665 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:23.346672 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:23.346675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:23.346886 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:23.347333 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:23.347337 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:23.347340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:23.347843 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:23.348104 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:23.348535 (+ 431us) server_negotiation.cc:299] Negotiation successful
0812 00:32:23.348740 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":266,"threads_started":1}
I20260812 00:32:23.350447 23881 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:23.358654 24391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:23.357757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46283 (local address 127.29.190.131:57045)
0812 00:32:23.358306 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:23.358443 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.190:46283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":254,"threads_started":1}
I20260812 00:32:23.441382 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 23608
I20260812 00:32:23.470654 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 23895
I20260812 00:32:23.489216 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:23.471580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60758 (local address 127.29.190.130:44123)
0812 00:32:23.472141 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:23.472146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:23.472164 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:32:23.472226 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:23.472229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:23.472304 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:23.472402 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:23.473864 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:23.474962 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:23.476392 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:23.476969 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:23.477101 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:23.483160 (+ 6059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:23.483166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:23.483170 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:23.483214 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:23.486235 (+ 3021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:23.486956 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:23.486961 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:23.486964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:23.487118 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:23.487566 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:23.487570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:23.487573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:23.487904 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:23.488141 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:23.488499 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 00:32:23.488752 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":313,"threads_started":1}
I20260812 00:32:23.490131 24096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:23.576431 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 23895
I20260812 00:32:23.605319 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 24105
I20260812 00:32:23.622030 24396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:23.606462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34940 (local address 127.29.190.131:35289)
0812 00:32:23.607138 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:23.607144 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:23.607162 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:32:23.607224 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:23.607228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:23.607303 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:23.607467 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:23.609048 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:23.609959 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:23.611353 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:23.611933 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:23.612087 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:23.615296 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:23.615310 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:23.615330 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:23.615379 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:23.618654 (+ 3275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:23.619595 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:23.619601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:23.619604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:23.619833 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:23.620273 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:23.620296 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:23.620300 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:23.620664 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:23.620968 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:23.621304 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 00:32:23.621572 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":362,"threads_started":1}
I20260812 00:32:23.623087 24292 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:23.709252 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 24105
2026-08-12T00:32:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65443 ms)
[----------] 30 tests from SecurityITest (316964 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:23 dist-test-slave-c12x krb5kdc[24402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:23 dist-test-slave-c12x krb5kdc[24402](info): set up 2 sockets
Aug 12 00:32:23 dist-test-slave-c12x krb5kdc[24402](info): commencing operation
krb5kdc: starting...
W20260812 00:32:25.082938 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:32:25 dist-test-slave-c12x krb5kdc[24402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:32:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:32:25.399614 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:45829
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:45829
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:25.759069 24425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:25.759371 24425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:25.759552 24425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:25.767015 24425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:25.767115 24425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:25.767203 24425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:25.767314 24425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:25.767403 24425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:25.778041 24425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:45829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:45829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:25.779500 24425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:25.780879 24425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:25.797704 24432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:25.797876 24436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:25.797955 24425 server_base.cc:1034] running on GCE node
W20260812 00:32:25.797905 24433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:25.799135 24425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:25.800777 24425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:25.802016 24425 hybrid_clock.cc:648] HybridClock initialized: now 1786494745801954 us; error 54 us; skew 500 ppm
I20260812 00:32:25.802390 24425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:25 dist-test-slave-c12x krb5kdc[24402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494745, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:25.805644 24425 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:32:25.807229 24425 webserver.cc:460] Webserver started at http://127.29.190.190:43391/ using document root <none> and password file <none>
I20260812 00:32:25.807981 24425 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:25.808096 24425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:25.808357 24425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:25.811586 24425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "1d27ad21a4f14d1e839e0119be6aa058"
format_stamp: "Formatted at 2026-08-12 00:32:25 on dist-test-slave-c12x"
server_key: "9bdd2d12102a7269a659378472d6a75e"
server_key_iv: "30f8e0e8e66cc36784336cef94c64f0a"
server_key_version: "encryptionkey@0"
I20260812 00:32:25.812356 24425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "1d27ad21a4f14d1e839e0119be6aa058"
format_stamp: "Formatted at 2026-08-12 00:32:25 on dist-test-slave-c12x"
server_key: "9bdd2d12102a7269a659378472d6a75e"
server_key_iv: "30f8e0e8e66cc36784336cef94c64f0a"
server_key_version: "encryptionkey@0"
I20260812 00:32:25.817691 24425 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 00:32:25.821312 24445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:25.822705 24425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:32:25.822851 24425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "1d27ad21a4f14d1e839e0119be6aa058"
format_stamp: "Formatted at 2026-08-12 00:32:25 on dist-test-slave-c12x"
server_key: "9bdd2d12102a7269a659378472d6a75e"
server_key_iv: "30f8e0e8e66cc36784336cef94c64f0a"
server_key_version: "encryptionkey@0"
I20260812 00:32:25.823019 24425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:25.845724 24425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:25.850384 24425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:25.850638 24425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:25.871279 24425 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:45829
I20260812 00:32:25.871448 24520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:45829 every 8 connection(s)
I20260812 00:32:25.872773 24425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:25.876827 24521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:25.881246 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 24425
I20260812 00:32:25.881515 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:25.882472 30458 external_mini_cluster.cc:1428] Setting key b1f707383a0058438c731dae58fc8d74
I20260812 00:32:25.892081 24521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058: Bootstrap starting.
I20260812 00:32:25.896263 24521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:25.897754 24521 log.cc:824] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:32:25 dist-test-slave-c12x krb5kdc[24402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:25.901618 24521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058: No bootstrap required, opened a new log
I20260812 00:32:25.908962 24525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:25.884925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34766 (local address 127.29.190.190:45829)
0812 00:32:25.885760 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:25.885772 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:25.885814 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:32:25.887490 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:25.887546 (+ 56us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:25.887991 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:25.888348 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:25.890357 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:25.891830 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:25.893770 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:25.894605 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:25.894761 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:25.900738 (+ 5977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:25.900747 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:25.900763 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:25.900802 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:25.904353 (+ 3551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:25.905247 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:25.905253 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:25.905261 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:25.905466 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:25.905892 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:25.905896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:25.905899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:25.906503 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:25.906749 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:25.907297 (+ 548us) server_negotiation.cc:299] Negotiation successful
0812 00:32:25.907835 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":380,"threads_started":1}
I20260812 00:32:25.911149 24521 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d27ad21a4f14d1e839e0119be6aa058" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45829 } }
I20260812 00:32:25.911652 24521 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:25.911767 24521 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d27ad21a4f14d1e839e0119be6aa058, State: Initialized, Role: FOLLOWER
I20260812 00:32:25.912345 24521 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d27ad21a4f14d1e839e0119be6aa058" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45829 } }
I20260812 00:32:25.912560 24521 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:25.912659 24521 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:25.912789 24521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:25.914933 24521 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d27ad21a4f14d1e839e0119be6aa058" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45829 } }
I20260812 00:32:25.915395 24521 leader_election.cc:302] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d27ad21a4f14d1e839e0119be6aa058; no voters:
I20260812 00:32:25.916025 24521 leader_election.cc:288] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:25.916200 24527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:25.917042 24527 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [term 1 LEADER]: Becoming Leader. State: Replica: 1d27ad21a4f14d1e839e0119be6aa058, State: Running, Role: LEADER
I20260812 00:32:25.917662 24527 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d27ad21a4f14d1e839e0119be6aa058" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45829 } }
I20260812 00:32:25.918278 24521 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:25.920987 24532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d27ad21a4f14d1e839e0119be6aa058. Latest consensus state: current_term: 1 leader_uuid: "1d27ad21a4f14d1e839e0119be6aa058" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d27ad21a4f14d1e839e0119be6aa058" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45829 } } }
I20260812 00:32:25.920949 24528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d27ad21a4f14d1e839e0119be6aa058" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d27ad21a4f14d1e839e0119be6aa058" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45829 } } }
I20260812 00:32:25.921420 24528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:25.921420 24532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:25.928522 24542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:25.934341 24542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:25.944555 24542 catalog_manager.cc:1347] Generated new cluster ID: c366fef003f4466eab62a7dcb371447b
I20260812 00:32:25.944686 24542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:25.959510 24542 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:25.961169 24542 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:25.974236 24542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058: Generated new TSK 0
I20260812 00:32:25.975167 24542 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:32:26.062744 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45829
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:26.420624 24560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:26.420897 24560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:26.421079 24560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:26.428596 24560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:26.428712 24560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:26.428879 24560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:32:26.439250 24560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45829
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:26.440719 24560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:26.442072 24560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:26.455806 24571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:26.455780 24573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:26.455744 24575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:26.456840 24560 server_base.cc:1034] running on GCE node
I20260812 00:32:26.457515 24560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:26.458495 24560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:26.459739 24560 hybrid_clock.cc:648] HybridClock initialized: now 1786494746459677 us; error 52 us; skew 500 ppm
I20260812 00:32:26.460093 24560 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:26 dist-test-slave-c12x krb5kdc[24402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494746, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:26.463769 24560 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:32:26.465325 24560 webserver.cc:460] Webserver started at http://127.29.190.129:35605/ using document root <none> and password file <none>
I20260812 00:32:26.466038 24560 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:26.466193 24560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:26.466516 24560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:26.469551 24560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "ba2945b57b594ad190aeaea5278c21a5"
format_stamp: "Formatted at 2026-08-12 00:32:26 on dist-test-slave-c12x"
server_key: "5a60449148ec8dd726d39f6263b4139c"
server_key_iv: "cb3dbab7beaae04ab4d2011a23c13916"
server_key_version: "encryptionkey@0"
I20260812 00:32:26.470350 24560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "ba2945b57b594ad190aeaea5278c21a5"
format_stamp: "Formatted at 2026-08-12 00:32:26 on dist-test-slave-c12x"
server_key: "5a60449148ec8dd726d39f6263b4139c"
server_key_iv: "cb3dbab7beaae04ab4d2011a23c13916"
server_key_version: "encryptionkey@0"
I20260812 00:32:26.475955 24560 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 00:32:26.479530 24585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:26.480954 24560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:32:26.481144 24560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "ba2945b57b594ad190aeaea5278c21a5"
format_stamp: "Formatted at 2026-08-12 00:32:26 on dist-test-slave-c12x"
server_key: "5a60449148ec8dd726d39f6263b4139c"
server_key_iv: "cb3dbab7beaae04ab4d2011a23c13916"
server_key_version: "encryptionkey@0"
I20260812 00:32:26.481352 24560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:26.494906 24560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:26.499522 24560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:26.499883 24560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:26.500975 24560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:26.502461 24560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:26.502589 24560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:26.502756 24560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:26.502868 24560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:26.542307 24560 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:37217
I20260812 00:32:26.542429 24757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:37217 every 8 connection(s)
I20260812 00:32:26.543716 24560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:32:26.554262 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 24560
I20260812 00:32:26.554541 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:32:26.555290 30458 external_mini_cluster.cc:1428] Setting key 704a6ebb62c6a7fd0cf9b548499e39b6
Aug 12 00:32:26 dist-test-slave-c12x krb5kdc[24402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494746, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:26.567082 24762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:26.546616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51303 (local address 127.29.190.190:45829)
0812 00:32:26.547117 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:26.547121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:26.548105 (+ 984us) server_negotiation.cc:407] Connection header received
0812 00:32:26.550046 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:26.550052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:26.550144 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:26.550269 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:26.551876 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:26.552638 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:26.554594 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:26.555109 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:26.555233 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:26.559639 (+ 4406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:26.559653 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:26.559656 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:26.559689 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:26.563014 (+ 3325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:26.564122 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:26.564130 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:26.564136 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:26.564279 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:26.564861 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:26.564868 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:26.564873 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:26.565217 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:26.565354 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:26.566391 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0812 00:32:26.566632 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":285,"threads_started":1}
I20260812 00:32:26.568671 24764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:26.547084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:45829 (local address 127.29.190.129:51303)
0812 00:32:26.547922 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:26.547962 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:26.549735 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:26.550523 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:26.550531 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:26.551082 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:26.551694 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:26.551714 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:26.552797 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:26.552807 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:26.554334 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:26.554354 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:26.555378 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:26.555389 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:26.555718 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:26.556558 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:26.556584 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:26.559337 (+ 2753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:26.563177 (+ 3840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:26.563192 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:26.563213 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:26.563981 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:26.564412 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:26.564421 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:26.564427 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:26.564731 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:26.565369 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:26.565381 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:26.565910 (+ 529us) client_negotiation.cc:769] Sending connection context
0812 00:32:26.566276 (+ 366us) client_negotiation.cc:240] Negotiation successful
0812 00:32:26.566949 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":357,"threads_started":1}
I20260812 00:32:26.570593 24760 heartbeater.cc:347] Connected to a master server at 127.29.190.190:45829
I20260812 00:32:26.570994 24760 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:26.571888 24760 heartbeater.cc:511] Master 127.29.190.190:45829 requested a full tablet report, sending...
I20260812 00:32:26.574358 24469 ts_manager.cc:194] Registered new tserver with Master: ba2945b57b594ad190aeaea5278c21a5 (127.29.190.129:37217)
I20260812 00:32:26.576107 24469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:51303
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:32:26.625103 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45829
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:26.982913 24769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:26.983258 24769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:26.983426 24769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:26.990859 24769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:26.991027 24769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:26.991200 24769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:32:27.001358 24769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45829
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:27.002739 24769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:27.004199 24769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:27.017952 24777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:27.017896 24783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:27.017920 24779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:27.018908 24769 server_base.cc:1034] running on GCE node
I20260812 00:32:27.019657 24769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:27.020705 24769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:27.021973 24769 hybrid_clock.cc:648] HybridClock initialized: now 1786494747021925 us; error 45 us; skew 500 ppm
I20260812 00:32:27.022326 24769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:27 dist-test-slave-c12x krb5kdc[24402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494747, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:27.025681 24769 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:32:27.027253 24769 webserver.cc:460] Webserver started at http://127.29.190.130:33711/ using document root <none> and password file <none>
I20260812 00:32:27.028043 24769 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:27.028198 24769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:27.028580 24769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:27.031764 24769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "37dea209f96745f3af242b6fc8e3b566"
format_stamp: "Formatted at 2026-08-12 00:32:27 on dist-test-slave-c12x"
server_key: "2a9b7e8be6063ff2cbe0334a21eb0c61"
server_key_iv: "afb3d3dece4df6f2c4f7ae940305b463"
server_key_version: "encryptionkey@0"
I20260812 00:32:27.032578 24769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "37dea209f96745f3af242b6fc8e3b566"
format_stamp: "Formatted at 2026-08-12 00:32:27 on dist-test-slave-c12x"
server_key: "2a9b7e8be6063ff2cbe0334a21eb0c61"
server_key_iv: "afb3d3dece4df6f2c4f7ae940305b463"
server_key_version: "encryptionkey@0"
I20260812 00:32:27.037931 24769 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:32:27.041761 24792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:27.043052 24769 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:32:27.043229 24769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "37dea209f96745f3af242b6fc8e3b566"
format_stamp: "Formatted at 2026-08-12 00:32:27 on dist-test-slave-c12x"
server_key: "2a9b7e8be6063ff2cbe0334a21eb0c61"
server_key_iv: "afb3d3dece4df6f2c4f7ae940305b463"
server_key_version: "encryptionkey@0"
I20260812 00:32:27.043435 24769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:27.063308 24769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:27.067919 24769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:27.068238 24769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:27.069249 24769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:27.070616 24769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:27.070724 24769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:27.070883 24769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:27.070957 24769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:27.105559 24769 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:37335
I20260812 00:32:27.105612 24966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:37335 every 8 connection(s)
I20260812 00:32:27.106953 24769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:32:27.116264 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 24769
I20260812 00:32:27.116477 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:32:27.116935 30458 external_mini_cluster.cc:1428] Setting key 00b154a1cc2c15d8e1ca19600bc1264b
Aug 12 00:32:27 dist-test-slave-c12x krb5kdc[24402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494747, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:27.127890 24973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.109611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:46581 (local address 127.29.190.190:45829)
0812 00:32:27.110080 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.110085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.111064 (+ 979us) server_negotiation.cc:407] Connection header received
0812 00:32:27.113003 (+ 1939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.113009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.113100 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.113235 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:27.114772 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.115615 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.117381 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.118029 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.118181 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.121884 (+ 3703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:27.121889 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:27.121892 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:27.121925 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:27.124576 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:27.125296 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:27.125305 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:27.125309 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:27.125441 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:27.125885 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:27.125890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:27.125894 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:27.126175 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:27.126377 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.127149 (+ 772us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.127389 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":227,"threads_started":1}
I20260812 00:32:27.129035 24974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.110170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:45829 (local address 127.29.190.130:46581)
0812 00:32:27.110889 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:27.110938 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:27.112715 (+ 1777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:27.113490 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:27.113499 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:27.114028 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:27.114586 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.114603 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.115782 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.115787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.117230 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.117243 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.118282 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.118291 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.118547 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.119348 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:27.119387 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:27.121645 (+ 2258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:27.124722 (+ 3077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:27.124731 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:27.124747 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:27.125164 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:27.125560 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:27.125565 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:27.125569 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:27.125764 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:27.126315 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:27.126324 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:27.126734 (+ 410us) client_negotiation.cc:769] Sending connection context
0812 00:32:27.127074 (+ 340us) client_negotiation.cc:240] Negotiation successful
0812 00:32:27.127670 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":285,"threads_started":1}
I20260812 00:32:27.130538 24969 heartbeater.cc:347] Connected to a master server at 127.29.190.190:45829
I20260812 00:32:27.130887 24969 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:27.131743 24969 heartbeater.cc:511] Master 127.29.190.190:45829 requested a full tablet report, sending...
I20260812 00:32:27.133363 24469 ts_manager.cc:194] Registered new tserver with Master: 37dea209f96745f3af242b6fc8e3b566 (127.29.190.130:37335)
I20260812 00:32:27.134641 24469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:46581
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:32:27.187103 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45829
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:27.540185 24980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:27.540498 24980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:27.540663 24980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:27.548663 24980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:27.548779 24980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:27.548995 24980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:32:27.559046 24980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:45829
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:27.560396 24980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:27.561764 24980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:27.576367 24987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:27.576417 24988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:27.576306 24990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:27.577859 24980 server_base.cc:1034] running on GCE node
I20260812 00:32:27.578462 24980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:27.579528 24980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:27.579674 24760 heartbeater.cc:503] Master 127.29.190.190:45829 was elected leader, sending a full tablet report...
I20260812 00:32:27.580785 24980 hybrid_clock.cc:648] HybridClock initialized: now 1786494747580715 us; error 53 us; skew 500 ppm
I20260812 00:32:27.581200 24980 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:27 dist-test-slave-c12x krb5kdc[24402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494747, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:27.584738 24980 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:32:27.586457 24980 webserver.cc:460] Webserver started at http://127.29.190.131:42869/ using document root <none> and password file <none>
I20260812 00:32:27.587201 24980 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:27.587344 24980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:27.587749 24980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:27.590863 24980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "c7dd148771ec4cb48484bc480f02a965"
format_stamp: "Formatted at 2026-08-12 00:32:27 on dist-test-slave-c12x"
server_key: "c99e1bc470388c159ab7ce3c4ed99726"
server_key_iv: "78fc743ce7175aac649ec9739e160c21"
server_key_version: "encryptionkey@0"
I20260812 00:32:27.591771 24980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "c7dd148771ec4cb48484bc480f02a965"
format_stamp: "Formatted at 2026-08-12 00:32:27 on dist-test-slave-c12x"
server_key: "c99e1bc470388c159ab7ce3c4ed99726"
server_key_iv: "78fc743ce7175aac649ec9739e160c21"
server_key_version: "encryptionkey@0"
I20260812 00:32:27.597245 24980 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:32:27.601125 25000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:27.602613 24980 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:32:27.602826 24980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "c7dd148771ec4cb48484bc480f02a965"
format_stamp: "Formatted at 2026-08-12 00:32:27 on dist-test-slave-c12x"
server_key: "c99e1bc470388c159ab7ce3c4ed99726"
server_key_iv: "78fc743ce7175aac649ec9739e160c21"
server_key_version: "encryptionkey@0"
I20260812 00:32:27.603053 24980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:27.623111 24980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:27.628517 24980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:27.628906 24980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:27.630318 24980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:27.631826 24980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:27.631932 24980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:27.632092 24980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:27.632167 24980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:27.669795 24980 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:36311
I20260812 00:32:27.669842 25178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:36311 every 8 connection(s)
I20260812 00:32:27.671198 24980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:32:27.679665 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 24980
I20260812 00:32:27.679899 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:32:27.680406 30458 external_mini_cluster.cc:1428] Setting key e3b431ee5a12a63fb09de41664f3bd0c
Aug 12 00:32:27 dist-test-slave-c12x krb5kdc[24402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494747, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:27.693147 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.674073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:53461 (local address 127.29.190.190:45829)
0812 00:32:27.674711 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.674716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.675811 (+ 1095us) server_negotiation.cc:407] Connection header received
0812 00:32:27.677626 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.677630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.677714 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.677824 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:27.679408 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.680575 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.682780 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.683204 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.683329 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.687329 (+ 4000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:27.687335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:27.687338 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:27.687374 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:27.689944 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:27.690797 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:27.690802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:27.690804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:27.690930 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:27.691337 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:27.691340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:27.691342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:27.691678 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:27.691801 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.692642 (+ 841us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.692842 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":287,"threads_started":1}
I20260812 00:32:27.694221 25184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.674703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:45829 (local address 127.29.190.131:53461)
0812 00:32:27.675638 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:27.675692 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:27.677350 (+ 1658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:27.678040 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:27.678048 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:27.678618 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:27.679195 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.679213 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.680759 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.680772 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.682594 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.682634 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.683495 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.683506 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.683819 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.684533 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:27.684560 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:27.687107 (+ 2547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:27.690154 (+ 3047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:27.690163 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:27.690178 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:27.690675 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:27.691034 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:27.691038 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:27.691040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:27.691240 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:27.691823 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:27.691830 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:27.692212 (+ 382us) client_negotiation.cc:769] Sending connection context
0812 00:32:27.692475 (+ 263us) client_negotiation.cc:240] Negotiation successful
0812 00:32:27.692904 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":344,"threads_started":1}
I20260812 00:32:27.696061 25180 heartbeater.cc:347] Connected to a master server at 127.29.190.190:45829
I20260812 00:32:27.696427 25180 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:27.697201 25180 heartbeater.cc:511] Master 127.29.190.190:45829 requested a full tablet report, sending...
I20260812 00:32:27.698673 24469 ts_manager.cc:194] Registered new tserver with Master: c7dd148771ec4cb48484bc480f02a965 (127.29.190.131:36311)
I20260812 00:32:27.699549 24469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:53461
I20260812 00:32:27.709328 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:32:27.729202 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.716350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42850 (local address 127.29.190.190:45829)
0812 00:32:27.716534 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.716539 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.717052 (+ 513us) server_negotiation.cc:407] Connection header received
0812 00:32:27.717206 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.717210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.717291 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.717382 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:27.718952 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.719792 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.721116 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.721522 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.721616 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.724080 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:27.724085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:27.724088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:27.724121 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:27.726715 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:27.727364 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:27.727368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:27.727371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:27.727572 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:27.727896 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:27.727899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:27.727901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:27.728228 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:27.728406 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.728739 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.728903 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 00:32:27.733292 24469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:32:27.740401 24469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:32:27.767307 25206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.754341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56572 (local address 127.29.190.130:37335)
0812 00:32:27.755169 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.755182 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.755839 (+ 657us) server_negotiation.cc:407] Connection header received
0812 00:32:27.756238 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.756250 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.756561 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.756766 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:27.757966 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.760130 (+ 2164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.764546 (+ 4416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.765956 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.766128 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.766344 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.766802 (+ 458us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.766980 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":514,"threads_started":1}
I20260812 00:32:27.767346 25210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.753984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:37335 (local address 127.0.0.1:56572)
0812 00:32:27.755711 (+ 1727us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:27.755733 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:27.755978 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:27.757189 (+ 1211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:27.757201 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:27.757243 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:27.757688 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.757704 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.760379 (+ 2675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.760388 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.763606 (+ 3218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.763629 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.766259 (+ 2630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.766266 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.766537 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.766593 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 00:32:27.766727 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 00:32:27.766905 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1563,"mutex_wait_us":582,"thread_start_us":9365,"threads_started":1}
I20260812 00:32:27.771688 24866 tablet_service.cc:1467] Processing CreateTablet for tablet ee6c14ffedc44e72bdf0de2a3927c18f (DEFAULT_TABLE table=test-table [id=0b1e01186f4f4bda952faa87f529b720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:27.773253 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.753273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:36311 (local address 127.0.0.1:39396)
0812 00:32:27.754256 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:27.754297 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:27.754482 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:27.765291 (+ 10809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:27.765297 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:27.765325 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:27.765714 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.765727 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.768376 (+ 2649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.768381 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.770403 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.770416 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.772329 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.772336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.772521 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.772560 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 00:32:27.772638 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:32:27.772787 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":4,"thread_start_us":563,"threads_started":1}
I20260812 00:32:27.773285 24866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee6c14ffedc44e72bdf0de2a3927c18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:27.773882 25211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.755655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42546 (local address 127.29.190.129:37217)
0812 00:32:27.765279 (+ 9624us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.765288 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.765313 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:32:27.765412 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.765422 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.765647 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.765862 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:27.766576 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.768188 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.770727 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.772158 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.772353 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.772526 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.773357 (+ 831us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.773532 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9439,"thread_start_us":9248,"threads_started":1}
I20260812 00:32:27.773974 25207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.754789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:37217 (local address 127.0.0.1:42546)
0812 00:32:27.764243 (+ 9454us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:27.764266 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:27.764389 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:27.765875 (+ 1486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:27.765881 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:27.765909 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:27.766350 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.766370 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.768338 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.768345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.770553 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.770568 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.772682 (+ 2114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.772688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.772846 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.772879 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:32:27.772984 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 00:32:27.773108 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9323,"mutex_wait_us":2,"thread_start_us":1113,"threads_started":1}
I20260812 00:32:27.774138 25205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.753718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39396 (local address 127.29.190.131:36311)
0812 00:32:27.764674 (+ 10956us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.764683 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.764716 (+ 33us) server_negotiation.cc:407] Connection header received
0812 00:32:27.764812 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.764822 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.765086 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.765292 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:27.765918 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.768222 (+ 2304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.770572 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.772074 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.773183 (+ 1109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.773447 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.773536 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.773693 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10769,"thread_start_us":10603,"threads_started":1}
I20260812 00:32:27.777437 25070 tablet_service.cc:1467] Processing CreateTablet for tablet ee6c14ffedc44e72bdf0de2a3927c18f (DEFAULT_TABLE table=test-table [id=0b1e01186f4f4bda952faa87f529b720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:27.777823 24662 tablet_service.cc:1467] Processing CreateTablet for tablet ee6c14ffedc44e72bdf0de2a3927c18f (DEFAULT_TABLE table=test-table [id=0b1e01186f4f4bda952faa87f529b720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:27.778944 25070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee6c14ffedc44e72bdf0de2a3927c18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:27.779176 24662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee6c14ffedc44e72bdf0de2a3927c18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:27.788621 25213 tablet_bootstrap.cc:492] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Bootstrap starting.
I20260812 00:32:27.790834 25215 tablet_bootstrap.cc:492] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Bootstrap starting.
I20260812 00:32:27.792410 25213 tablet_bootstrap.cc:654] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:27.793639 25213 log.cc:824] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:27.793883 25216 tablet_bootstrap.cc:492] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: Bootstrap starting.
I20260812 00:32:27.794760 25215 tablet_bootstrap.cc:654] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:27.796063 25215 log.cc:824] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:27.797648 25216 tablet_bootstrap.cc:654] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:27.798300 25213 tablet_bootstrap.cc:492] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: No bootstrap required, opened a new log
I20260812 00:32:27.798597 25213 ts_tablet_manager.cc:1397] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260812 00:32:27.798707 25215 tablet_bootstrap.cc:492] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: No bootstrap required, opened a new log
I20260812 00:32:27.798883 25216 log.cc:824] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:27.798972 25215 ts_tablet_manager.cc:1397] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 00:32:27.801894 25216 tablet_bootstrap.cc:492] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: No bootstrap required, opened a new log
I20260812 00:32:27.802160 25216 ts_tablet_manager.cc:1397] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260812 00:32:27.806841 25215 raft_consensus.cc:348] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.807269 25215 raft_consensus.cc:374] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:27.807384 25215 raft_consensus.cc:729] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7dd148771ec4cb48484bc480f02a965, State: Initialized, Role: FOLLOWER
I20260812 00:32:27.808009 25215 consensus_queue.cc:260] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.809245 25180 heartbeater.cc:503] Master 127.29.190.190:45829 was elected leader, sending a full tablet report...
I20260812 00:32:27.809212 25213 raft_consensus.cc:348] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.809639 25213 raft_consensus.cc:374] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:27.809754 25213 raft_consensus.cc:729] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37dea209f96745f3af242b6fc8e3b566, State: Initialized, Role: FOLLOWER
I20260812 00:32:27.809935 25215 ts_tablet_manager.cc:1428] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Time spent starting tablet: real 0.011s user 0.004s sys 0.007s
I20260812 00:32:27.810328 25213 consensus_queue.cc:260] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.811476 24969 heartbeater.cc:503] Master 127.29.190.190:45829 was elected leader, sending a full tablet report...
I20260812 00:32:27.812119 25213 ts_tablet_manager.cc:1428] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
I20260812 00:32:27.813130 25216 raft_consensus.cc:348] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.813593 25216 raft_consensus.cc:374] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:27.813701 25216 raft_consensus.cc:729] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2945b57b594ad190aeaea5278c21a5, State: Initialized, Role: FOLLOWER
I20260812 00:32:27.814319 25216 consensus_queue.cc:260] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.816193 25216 ts_tablet_manager.cc:1428] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: Time spent starting tablet: real 0.014s user 0.010s sys 0.005s
W20260812 00:32:27.859129 24972 tablet.cc:2369] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:27.901577 25233 raft_consensus.cc:482] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:27.901948 25233 raft_consensus.cc:504] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.903968 25233 leader_election.cc:288] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba2945b57b594ad190aeaea5278c21a5 (127.29.190.129:37217), 37dea209f96745f3af242b6fc8e3b566 (127.29.190.130:37335)
I20260812 00:32:27.911633 25211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.904427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:54813 (local address 127.29.190.129:37217)
0812 00:32:27.904686 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.904694 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.905002 (+ 308us) server_negotiation.cc:407] Connection header received
0812 00:32:27.905216 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.905222 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.905308 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.905388 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:27.905864 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.906873 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.909427 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.910624 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.910793 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.910875 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.911172 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.911309 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 00:32:27.911672 25184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.904382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:37217 (local address 127.29.190.131:54813)
0812 00:32:27.904815 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:27.904832 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:27.905031 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:27.905459 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:27.905464 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:27.905493 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:27.905710 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.905729 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.907001 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.907006 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.909254 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.909273 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.910787 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.910792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.910990 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.911016 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 00:32:27.911122 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:32:27.911271 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":2}
I20260812 00:32:27.912061 25206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.904680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:49681 (local address 127.29.190.130:37335)
0812 00:32:27.904927 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.904936 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.905500 (+ 564us) server_negotiation.cc:407] Connection header received
0812 00:32:27.905706 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.905710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.905766 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.905885 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:27.906401 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.907318 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.909754 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.911003 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.911182 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.911249 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.911644 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.911790 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:32:27.912510 25240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.904532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:37335 (local address 127.29.190.131:49681)
0812 00:32:27.905353 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:27.905394 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:27.905575 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:27.905906 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:27.905909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:27.905938 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:27.906234 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.906242 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.907477 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.907482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.909598 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:27.909609 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.911217 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.911223 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:27.911385 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.911425 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 00:32:27.911588 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 00:32:27.912109 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":48,"spinlock_wait_cycles":24320,"thread_start_us":479,"threads_started":1}
I20260812 00:32:27.912799 24692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6c14ffedc44e72bdf0de2a3927c18f" candidate_uuid: "c7dd148771ec4cb48484bc480f02a965" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2945b57b594ad190aeaea5278c21a5" is_pre_election: true
I20260812 00:32:27.913360 24692 raft_consensus.cc:2454] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7dd148771ec4cb48484bc480f02a965 in term 0.
I20260812 00:32:27.913473 24892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6c14ffedc44e72bdf0de2a3927c18f" candidate_uuid: "c7dd148771ec4cb48484bc480f02a965" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37dea209f96745f3af242b6fc8e3b566" is_pre_election: true
I20260812 00:32:27.914059 24892 raft_consensus.cc:2454] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7dd148771ec4cb48484bc480f02a965 in term 0.
I20260812 00:32:27.914132 25001 leader_election.cc:302] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba2945b57b594ad190aeaea5278c21a5, c7dd148771ec4cb48484bc480f02a965; no voters:
I20260812 00:32:27.914595 25233 raft_consensus.cc:2781] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:32:27.914763 25233 raft_consensus.cc:482] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:32:27.914897 25233 raft_consensus.cc:3037] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:27.917163 25233 raft_consensus.cc:504] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.917850 25233 leader_election.cc:288] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [CANDIDATE]: Term 1 election: Requested vote from peers ba2945b57b594ad190aeaea5278c21a5 (127.29.190.129:37217), 37dea209f96745f3af242b6fc8e3b566 (127.29.190.130:37335)
I20260812 00:32:27.918319 24692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6c14ffedc44e72bdf0de2a3927c18f" candidate_uuid: "c7dd148771ec4cb48484bc480f02a965" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2945b57b594ad190aeaea5278c21a5"
I20260812 00:32:27.918351 24892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6c14ffedc44e72bdf0de2a3927c18f" candidate_uuid: "c7dd148771ec4cb48484bc480f02a965" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37dea209f96745f3af242b6fc8e3b566"
I20260812 00:32:27.918541 24892 raft_consensus.cc:3037] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:27.918561 24692 raft_consensus.cc:3037] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:27.921870 24692 raft_consensus.cc:2454] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7dd148771ec4cb48484bc480f02a965 in term 1.
I20260812 00:32:27.921875 24892 raft_consensus.cc:2454] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7dd148771ec4cb48484bc480f02a965 in term 1.
I20260812 00:32:27.922329 25005 leader_election.cc:302] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37dea209f96745f3af242b6fc8e3b566, c7dd148771ec4cb48484bc480f02a965; no voters:
I20260812 00:32:27.922676 25233 raft_consensus.cc:2781] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 00:32:27.923012 25182 tablet.cc:2369] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:27.923235 25233 raft_consensus.cc:686] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 1 LEADER]: Becoming Leader. State: Replica: c7dd148771ec4cb48484bc480f02a965, State: Running, Role: LEADER
I20260812 00:32:27.923777 25233 consensus_queue.cc:237] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } }
I20260812 00:32:27.927984 24467 catalog_manager.cc:5495] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7dd148771ec4cb48484bc480f02a965 (127.29.190.131). New cstate: current_term: 1 leader_uuid: "c7dd148771ec4cb48484bc480f02a965" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7dd148771ec4cb48484bc480f02a965" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 } health_report { overall_health: UNKNOWN } } }
I20260812 00:32:27.959525 25205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:27.953709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39404 (local address 127.29.190.131:36311)
0812 00:32:27.953942 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:27.953949 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:27.954031 (+ 82us) server_negotiation.cc:407] Connection header received
0812 00:32:27.954292 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:27.954296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:27.954389 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:27.954565 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:32:27.954978 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.955776 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.957262 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:27.957676 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:27.957820 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:27.958365 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:32:27.958888 (+ 523us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:32:27.959075 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:27.959129 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 00:32:27.959212 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:32:27.968494 24892 raft_consensus.cc:1261] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 1 FOLLOWER]: Refusing update from remote peer c7dd148771ec4cb48484bc480f02a965: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:27.968535 24692 raft_consensus.cc:1261] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 1 FOLLOWER]: Refusing update from remote peer c7dd148771ec4cb48484bc480f02a965: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:27.969566 25242 consensus_queue.cc:1035] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37dea209f96745f3af242b6fc8e3b566" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:27.969937 25233 consensus_queue.cc:1035] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2945b57b594ad190aeaea5278c21a5" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:27.983017 25247 mvcc.cc:205] Tried to move back new op lower bound from 7317482487667535872 to 7317482487499661312. Current Snapshot: MvccSnapshot[applied={T|T < 7317482487667535872}]
I20260812 00:32:27.985002 25249 mvcc.cc:205] Tried to move back new op lower bound from 7317482487667535872 to 7317482487499661312. Current Snapshot: MvccSnapshot[applied={T|T < 7317482487667535872}]
I20260812 00:32:28.001674 24467 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:28.002004 24467 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:28.006108 24467 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d27ad21a4f14d1e839e0119be6aa058: Sending DeleteTablet for 3 replicas of tablet ee6c14ffedc44e72bdf0de2a3927c18f
I20260812 00:32:28.007365 25070 tablet_service.cc:1514] Processing DeleteTablet for tablet ee6c14ffedc44e72bdf0de2a3927c18f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:27 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:39396
I20260812 00:32:28.007588 24866 tablet_service.cc:1514] Processing DeleteTablet for tablet ee6c14ffedc44e72bdf0de2a3927c18f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:27 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:56572
I20260812 00:32:28.007748 24662 tablet_service.cc:1514] Processing DeleteTablet for tablet ee6c14ffedc44e72bdf0de2a3927c18f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:27 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:42546
I20260812 00:32:28.010807 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 24560
I20260812 00:32:28.020149 25261 tablet_replica.cc:330] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: stopping tablet replica
I20260812 00:32:28.020823 25261 raft_consensus.cc:2229] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:28.021548 25261 raft_consensus.cc:2258] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:28.022603 25259 tablet_replica.cc:330] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: stopping tablet replica
I20260812 00:32:28.023156 25259 raft_consensus.cc:2229] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:28.023801 25259 raft_consensus.cc:2258] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:28.024442 25257 tablet_replica.cc:330] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: stopping tablet replica
I20260812 00:32:28.024884 25257 raft_consensus.cc:2229] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:32:28.025635 25257 raft_consensus.cc:2258] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:28.026144 25259 ts_tablet_manager.cc:1905] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:28.026294 25261 ts_tablet_manager.cc:1905] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:28.028851 25257 ts_tablet_manager.cc:1905] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:28.034726 25261 ts_tablet_manager.cc:1918] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:28.035012 25261 log.cc:1196] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/ee6c14ffedc44e72bdf0de2a3927c18f
I20260812 00:32:28.035719 25261 ts_tablet_manager.cc:1939] T ee6c14ffedc44e72bdf0de2a3927c18f P ba2945b57b594ad190aeaea5278c21a5: Deleting consensus metadata
I20260812 00:32:28.037907 24446 catalog_manager.cc:4841] TS ba2945b57b594ad190aeaea5278c21a5 (127.29.190.129:37217): tablet ee6c14ffedc44e72bdf0de2a3927c18f (table test-table [id=0b1e01186f4f4bda952faa87f529b720]) successfully deleted
I20260812 00:32:28.037958 25259 ts_tablet_manager.cc:1918] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:28.038161 25259 log.cc:1196] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/ee6c14ffedc44e72bdf0de2a3927c18f
I20260812 00:32:28.038745 25259 ts_tablet_manager.cc:1939] T ee6c14ffedc44e72bdf0de2a3927c18f P 37dea209f96745f3af242b6fc8e3b566: Deleting consensus metadata
I20260812 00:32:28.040542 25257 ts_tablet_manager.cc:1918] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:28.040745 25257 log.cc:1196] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/ee6c14ffedc44e72bdf0de2a3927c18f
I20260812 00:32:28.040673 24450 catalog_manager.cc:4841] TS 37dea209f96745f3af242b6fc8e3b566 (127.29.190.130:37335): tablet ee6c14ffedc44e72bdf0de2a3927c18f (table test-table [id=0b1e01186f4f4bda952faa87f529b720]) successfully deleted
I20260812 00:32:28.041261 25257 ts_tablet_manager.cc:1939] T ee6c14ffedc44e72bdf0de2a3927c18f P c7dd148771ec4cb48484bc480f02a965: Deleting consensus metadata
I20260812 00:32:28.042822 24446 catalog_manager.cc:4841] TS c7dd148771ec4cb48484bc480f02a965 (127.29.190.131:36311): tablet ee6c14ffedc44e72bdf0de2a3927c18f (table test-table [id=0b1e01186f4f4bda952faa87f529b720]) successfully deleted
Aug 12 00:32:28 dist-test-slave-c12x krb5kdc[24402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:32:28.051152 25211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:28.012651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42560 (local address 127.29.190.129:37217)
0812 00:32:28.012892 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:28.012901 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:28.026427 (+ 13526us) server_negotiation.cc:407] Connection header received
0812 00:32:28.026789 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:28.026795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:28.026880 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:28.026966 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:28.029057 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:28.030352 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:28.032451 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:28.033176 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:28.033278 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:28.044575 (+ 11297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:28.044590 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:28.044606 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:28.044651 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:28.048025 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:28.048939 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:28.048946 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:28.048949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:28.049087 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:28.049593 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:28.049598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:28.049600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:28.049980 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:28.050228 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:28.050621 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 00:32:28.050806 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:32:28.051870 24751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:28.189383 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 24560
I20260812 00:32:28.220765 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 24769
Aug 12 00:32:28 dist-test-slave-c12x krb5kdc[24402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:32:28.240510 25206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:28.221713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56582 (local address 127.29.190.130:37335)
0812 00:32:28.221913 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:28.221917 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:28.222017 (+ 100us) server_negotiation.cc:407] Connection header received
0812 00:32:28.222200 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:28.222204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:28.222282 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:28.222368 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:28.224396 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:28.225160 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:28.227170 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:28.227646 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:28.227787 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:28.233895 (+ 6108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:28.233914 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:28.233931 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:28.233973 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:28.237139 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:28.238134 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:28.238142 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:28.238144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:28.238282 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:28.238773 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:28.238778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:28.238780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:28.239225 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:28.239705 (+ 480us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:28.239976 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 00:32:28.240162 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:32:28.241304 24958 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:28.331768 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 24769
I20260812 00:32:28.360709 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 24980
Aug 12 00:32:28 dist-test-slave-c12x krb5kdc[24402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:32:28.379670 25205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:28.361619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39408 (local address 127.29.190.131:36311)
0812 00:32:28.361864 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:28.361873 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:28.361897 (+ 24us) server_negotiation.cc:407] Connection header received
0812 00:32:28.361971 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:28.361977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:28.362139 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:28.362257 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:28.364069 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:28.365384 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:28.367079 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:28.367770 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:28.367946 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:28.372864 (+ 4918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:28.372892 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:28.372911 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:28.372956 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:28.376353 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:28.377108 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:28.377124 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:28.377126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:28.377342 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:28.377827 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:28.377832 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:28.377835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:28.378230 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:28.378598 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:28.378916 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 00:32:28.379160 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:32:28.380488 25172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:28.531304 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 24980
I20260812 00:32:28.556989 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 24425
I20260812 00:32:28.558179 24514 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:28.670979 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 24425
2026-08-12T00:32:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4968 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T00:32:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:28Z Disabled control of system clock
I20260812 00:32:28.776661 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:33049
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:33049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:32:29.145476 25276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:29.145785 25276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:29.145872 25276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:29.153354 25276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:29.153479 25276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:29.153519 25276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:29.153570 25276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:29.153616 25276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:29.163048 25276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:33049
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:33049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:29.164489 25276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:29.166345 25276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:29.179049 25282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:29.179075 25285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:29.179548 25287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:29.185353 25276 server_base.cc:1034] running on GCE node
I20260812 00:32:29.186353 25276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:29.188076 25276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:29.189316 25276 hybrid_clock.cc:648] HybridClock initialized: now 1786494749189271 us; error 32 us; skew 500 ppm
I20260812 00:32:29.189725 25276 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:29.196851 25276 webserver.cc:460] Webserver started at http://127.29.190.190:41249/ using document root <none> and password file <none>
I20260812 00:32:29.197640 25276 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:29.197736 25276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:29.198043 25276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:29.201262 25276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "0467756dad644ad09d6c41c3f4223ca1"
format_stamp: "Formatted at 2026-08-12 00:32:29 on dist-test-slave-c12x"
server_key: "6e103fff0deb957c3473d652212b1464"
server_key_iv: "92c9793979af5beb1e650faec2eeb013"
server_key_version: "encryptionkey@0"
I20260812 00:32:29.202093 25276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "0467756dad644ad09d6c41c3f4223ca1"
format_stamp: "Formatted at 2026-08-12 00:32:29 on dist-test-slave-c12x"
server_key: "6e103fff0deb957c3473d652212b1464"
server_key_iv: "92c9793979af5beb1e650faec2eeb013"
server_key_version: "encryptionkey@0"
I20260812 00:32:29.208081 25276 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 00:32:29.212007 25294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:29.213466 25276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:32:29.213672 25276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "0467756dad644ad09d6c41c3f4223ca1"
format_stamp: "Formatted at 2026-08-12 00:32:29 on dist-test-slave-c12x"
server_key: "6e103fff0deb957c3473d652212b1464"
server_key_iv: "92c9793979af5beb1e650faec2eeb013"
server_key_version: "encryptionkey@0"
I20260812 00:32:29.213910 25276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:29.231658 25276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:29.232616 25276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:29.232945 25276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:29.253847 25276 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:33049
I20260812 00:32:29.253866 25375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:33049 every 8 connection(s)
I20260812 00:32:29.255322 25276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:29.258824 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 25276
I20260812 00:32:29.259070 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:29.259574 25376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:29.259642 30458 external_mini_cluster.cc:1428] Setting key 443a15d527c1bf561e59fc780b013e4e
I20260812 00:32:29.273901 25376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1: Bootstrap starting.
I20260812 00:32:29.274557 25382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:29.261602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34070 (local address 127.29.190.190:33049)
0812 00:32:29.262707 (+ 1105us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:29.262718 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:29.262762 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:32:29.264636 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:29.264659 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:29.265159 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:29.265591 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:29.266200 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:29.267606 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:29.269758 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:29.270475 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:29.270617 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:29.272055 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:29.272062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:29.272077 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:29.272663 (+ 586us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:29.272740 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:29.272762 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:29.272858 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:29.273098 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 00:32:29.273491 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":399,"threads_started":1}
I20260812 00:32:29.277841 25376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:29.278879 25376 log.cc:824] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:29.282189 25376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1: No bootstrap required, opened a new log
I20260812 00:32:29.290978 25376 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467756dad644ad09d6c41c3f4223ca1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33049 } }
I20260812 00:32:29.291420 25376 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:29.291612 25376 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0467756dad644ad09d6c41c3f4223ca1, State: Initialized, Role: FOLLOWER
I20260812 00:32:29.292301 25376 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467756dad644ad09d6c41c3f4223ca1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33049 } }
I20260812 00:32:29.292635 25376 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:29.292812 25376 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:29.293042 25376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:29.295612 25376 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467756dad644ad09d6c41c3f4223ca1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33049 } }
I20260812 00:32:29.296175 25376 leader_election.cc:302] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0467756dad644ad09d6c41c3f4223ca1; no voters:
I20260812 00:32:29.296788 25376 leader_election.cc:288] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:29.296976 25385 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:29.297938 25385 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [term 1 LEADER]: Becoming Leader. State: Replica: 0467756dad644ad09d6c41c3f4223ca1, State: Running, Role: LEADER
I20260812 00:32:29.298552 25385 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467756dad644ad09d6c41c3f4223ca1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33049 } }
I20260812 00:32:29.299552 25376 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:29.301714 25386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0467756dad644ad09d6c41c3f4223ca1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467756dad644ad09d6c41c3f4223ca1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33049 } } }
I20260812 00:32:29.302042 25387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0467756dad644ad09d6c41c3f4223ca1. Latest consensus state: current_term: 1 leader_uuid: "0467756dad644ad09d6c41c3f4223ca1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467756dad644ad09d6c41c3f4223ca1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 33049 } } }
I20260812 00:32:29.302292 25386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:29.302361 25387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:29.304245 25392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:29.309993 25392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:29.320415 25392 catalog_manager.cc:1347] Generated new cluster ID: be99cfd9e3ea48b290da8370cddc6e4a
I20260812 00:32:29.320555 25392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:29.349438 25392 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:29.351344 25392 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:29.361768 25392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1: Generated new TSK 0
I20260812 00:32:29.362900 25392 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:32:29.371672 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33049
--builtin_ntp_servers=127.29.190.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:32:29.734592 25415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:29.734951 25415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:29.735118 25415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:29.743217 25415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:29.743388 25415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:29.743631 25415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:32:29.753690 25415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:29.755105 25415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:29.757028 25415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:29.770691 25420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:29.770720 25422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:29.770758 25427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:29.771727 25415 server_base.cc:1034] running on GCE node
I20260812 00:32:29.772327 25415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:29.773319 25415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:29.774542 25415 hybrid_clock.cc:648] HybridClock initialized: now 1786494749774492 us; error 87 us; skew 500 ppm
I20260812 00:32:29.774901 25415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:29.777323 25415 webserver.cc:460] Webserver started at http://127.29.190.129:37969/ using document root <none> and password file <none>
I20260812 00:32:29.778041 25415 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:29.778162 25415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:29.778519 25415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:29.781615 25415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "06c549c897f344378c083648d4cd81ba"
format_stamp: "Formatted at 2026-08-12 00:32:29 on dist-test-slave-c12x"
server_key: "dff3735c986facd0d58a063c53cb95b9"
server_key_iv: "20b7a5aa73d531a66ae9164ff9dc4a07"
server_key_version: "encryptionkey@0"
I20260812 00:32:29.782429 25415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "06c549c897f344378c083648d4cd81ba"
format_stamp: "Formatted at 2026-08-12 00:32:29 on dist-test-slave-c12x"
server_key: "dff3735c986facd0d58a063c53cb95b9"
server_key_iv: "20b7a5aa73d531a66ae9164ff9dc4a07"
server_key_version: "encryptionkey@0"
I20260812 00:32:29.788268 25415 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:32:29.791759 25436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:29.793159 25415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:32:29.793406 25415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "06c549c897f344378c083648d4cd81ba"
format_stamp: "Formatted at 2026-08-12 00:32:29 on dist-test-slave-c12x"
server_key: "dff3735c986facd0d58a063c53cb95b9"
server_key_iv: "20b7a5aa73d531a66ae9164ff9dc4a07"
server_key_version: "encryptionkey@0"
I20260812 00:32:29.793682 25415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:29.805105 25415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:29.805919 25415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:29.806237 25415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:29.807216 25415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:29.808725 25415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:29.808856 25415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:29.808997 25415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:29.809093 25415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:29.844148 25415 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:37613
I20260812 00:32:29.844208 25618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:37613 every 8 connection(s)
I20260812 00:32:29.845606 25415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:32:29.854909 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 25415
I20260812 00:32:29.855110 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:32:29.855708 30458 external_mini_cluster.cc:1428] Setting key f5d95976b24586faffa02c1679e1bf93
I20260812 00:32:29.858556 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33049
--builtin_ntp_servers=127.29.190.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:32:29.859790 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:29.848519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:48949 (local address 127.29.190.190:33049)
0812 00:32:29.848989 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:29.848996 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:29.850297 (+ 1301us) server_negotiation.cc:407] Connection header received
0812 00:32:29.852416 (+ 2119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:29.852421 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:29.852505 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:29.852630 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:29.853876 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:29.854721 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:29.856635 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:29.857137 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:29.857280 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:29.858857 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:29.858861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:29.858864 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:29.858884 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:29.858927 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:29.858941 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:29.859042 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:29.859287 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 00:32:29.859397 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":220,"threads_started":1}
I20260812 00:32:29.861002 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:29.849140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:33049 (local address 127.29.190.129:48949)
0812 00:32:29.850122 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:29.850167 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:29.851957 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:29.852969 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:29.852978 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:29.853080 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:29.853683 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:29.853700 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:29.854899 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:29.854903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:29.856479 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:29.856493 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:29.857401 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:29.857410 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:29.857656 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:29.858401 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:29.858404 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:29.858452 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:29.858541 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:29.859049 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:29.859063 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:29.859074 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 00:32:29.859274 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 00:32:29.859745 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":323,"threads_started":1}
I20260812 00:32:29.862895 25622 heartbeater.cc:347] Connected to a master server at 127.29.190.190:33049
I20260812 00:32:29.863267 25622 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:29.864115 25622 heartbeater.cc:511] Master 127.29.190.190:33049 requested a full tablet report, sending...
I20260812 00:32:29.866611 25317 ts_manager.cc:194] Registered new tserver with Master: 06c549c897f344378c083648d4cd81ba (127.29.190.129:37613)
I20260812 00:32:29.868815 25317 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.129:48949
W20260812 00:32:30.222409 25628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:30.222761 25628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:30.222934 25628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:30.230331 25628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:30.230469 25628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:30.230654 25628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:32:30.240075 25628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:30.241442 25628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:30.243307 25628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:30.256886 25641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:30.256817 25638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:30.257059 25637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:30.258486 25628 server_base.cc:1034] running on GCE node
I20260812 00:32:30.259222 25628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:30.260423 25628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:30.261693 25628 hybrid_clock.cc:648] HybridClock initialized: now 1786494750261612 us; error 63 us; skew 500 ppm
I20260812 00:32:30.262056 25628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:30.264846 25628 webserver.cc:460] Webserver started at http://127.29.190.130:44025/ using document root <none> and password file <none>
I20260812 00:32:30.265692 25628 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:30.265815 25628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:30.266163 25628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:30.270123 25628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "1c5d12fcac6544ca8cfc9a22e0d95471"
format_stamp: "Formatted at 2026-08-12 00:32:30 on dist-test-slave-c12x"
server_key: "90518fb00d542fa3fa24fd4f3d8402da"
server_key_iv: "f9c8a393bf776fa9dd6ca215af238f30"
server_key_version: "encryptionkey@0"
I20260812 00:32:30.271175 25628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "1c5d12fcac6544ca8cfc9a22e0d95471"
format_stamp: "Formatted at 2026-08-12 00:32:30 on dist-test-slave-c12x"
server_key: "90518fb00d542fa3fa24fd4f3d8402da"
server_key_iv: "f9c8a393bf776fa9dd6ca215af238f30"
server_key_version: "encryptionkey@0"
I20260812 00:32:30.277743 25628 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 00:32:30.281380 25658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:30.282742 25628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:32:30.282934 25628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "1c5d12fcac6544ca8cfc9a22e0d95471"
format_stamp: "Formatted at 2026-08-12 00:32:30 on dist-test-slave-c12x"
server_key: "90518fb00d542fa3fa24fd4f3d8402da"
server_key_iv: "f9c8a393bf776fa9dd6ca215af238f30"
server_key_version: "encryptionkey@0"
I20260812 00:32:30.283166 25628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:30.309458 25628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:30.310362 25628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:30.310714 25628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:30.311879 25628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:30.313504 25628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:30.313606 25628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:30.313771 25628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:30.313845 25628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:30.349821 25628 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:43897
I20260812 00:32:30.349923 25845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:43897 every 8 connection(s)
I20260812 00:32:30.351248 25628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:32:30.352818 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 25628
I20260812 00:32:30.353024 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:32:30.353694 30458 external_mini_cluster.cc:1428] Setting key ba7ba59a277e0589d00ed76517ae28f0
I20260812 00:32:30.356726 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33049
--builtin_ntp_servers=127.29.190.148:36057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:32:30.365613 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.354144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:34235 (local address 127.29.190.190:33049)
0812 00:32:30.354364 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:30.354371 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:30.356089 (+ 1718us) server_negotiation.cc:407] Connection header received
0812 00:32:30.358009 (+ 1920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:30.358018 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:30.358115 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:30.358230 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:30.359303 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.360488 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.362302 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.363011 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.363156 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.364656 (+ 1500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:30.364665 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:30.364672 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:30.364700 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:30.364744 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:30.364763 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:30.364854 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:30.365094 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 00:32:30.365210 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 00:32:30.366658 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.354793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:33049 (local address 127.29.190.130:34235)
0812 00:32:30.355907 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:30.355954 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:30.357726 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:30.358434 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:30.358443 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:30.358528 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:30.359122 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.359140 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.360664 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.360669 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.362153 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.362167 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.363269 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.363274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.363552 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.364316 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:30.364319 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:30.364361 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:30.364446 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:30.364869 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:30.364877 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:30.364882 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:32:30.365025 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 00:32:30.365474 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":350,"threads_started":1}
I20260812 00:32:30.368376 25846 heartbeater.cc:347] Connected to a master server at 127.29.190.190:33049
I20260812 00:32:30.368742 25846 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:30.369614 25846 heartbeater.cc:511] Master 127.29.190.190:33049 requested a full tablet report, sending...
I20260812 00:32:30.371394 25317 ts_manager.cc:194] Registered new tserver with Master: 1c5d12fcac6544ca8cfc9a22e0d95471 (127.29.190.130:43897)
I20260812 00:32:30.372258 25317 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.130:34235
W20260812 00:32:30.713851 25849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:30.714185 25849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:30.714356 25849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:30.721768 25849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:30.721916 25849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:30.722107 25849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:32:30.733022 25849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:33049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:30.734424 25849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:30.736368 25849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:30.750020 25856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:30.750029 25861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:30.750746 25858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:30.750999 25849 server_base.cc:1034] running on GCE node
I20260812 00:32:30.751763 25849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:30.752828 25849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:30.754091 25849 hybrid_clock.cc:648] HybridClock initialized: now 1786494750754036 us; error 47 us; skew 500 ppm
I20260812 00:32:30.754456 25849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:30.757005 25849 webserver.cc:460] Webserver started at http://127.29.190.131:36425/ using document root <none> and password file <none>
I20260812 00:32:30.757809 25849 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:30.757954 25849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:30.758312 25849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:30.761549 25849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "103d4b08dd284762a49be87472f97226"
format_stamp: "Formatted at 2026-08-12 00:32:30 on dist-test-slave-c12x"
server_key: "d9d1e744e8f9f0426afa6ac3ad7d4b56"
server_key_iv: "1a08aee50810a8185e6738a2a8142a29"
server_key_version: "encryptionkey@0"
I20260812 00:32:30.762420 25849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "103d4b08dd284762a49be87472f97226"
format_stamp: "Formatted at 2026-08-12 00:32:30 on dist-test-slave-c12x"
server_key: "d9d1e744e8f9f0426afa6ac3ad7d4b56"
server_key_iv: "1a08aee50810a8185e6738a2a8142a29"
server_key_version: "encryptionkey@0"
I20260812 00:32:30.768159 25849 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 00:32:30.772174 25869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:30.773697 25849 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:32:30.773916 25849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "103d4b08dd284762a49be87472f97226"
format_stamp: "Formatted at 2026-08-12 00:32:30 on dist-test-slave-c12x"
server_key: "d9d1e744e8f9f0426afa6ac3ad7d4b56"
server_key_iv: "1a08aee50810a8185e6738a2a8142a29"
server_key_version: "encryptionkey@0"
I20260812 00:32:30.774169 25849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:30.790841 25849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:30.791814 25849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:30.792161 25849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:30.793215 25849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:30.794764 25849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:30.794893 25849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:30.795043 25849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:30.795136 25849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:30.838864 25849 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:36135
I20260812 00:32:30.839001 26055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:36135 every 8 connection(s)
I20260812 00:32:30.840354 25849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:32:30.847295 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 25849
I20260812 00:32:30.847570 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:32:30.848179 30458 external_mini_cluster.cc:1428] Setting key f3fbcd6ec2d3da6840d040e98757617c
I20260812 00:32:30.854724 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.843389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:33471 (local address 127.29.190.190:33049)
0812 00:32:30.843677 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:30.843684 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:30.845199 (+ 1515us) server_negotiation.cc:407] Connection header received
0812 00:32:30.847308 (+ 2109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:30.847315 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:30.847402 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:30.847535 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:30.849193 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.849954 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.851840 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.852275 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.852413 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.853842 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:30.853849 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:30.853854 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:30.853880 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:30.853924 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:30.853937 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:30.854084 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:30.854298 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 00:32:30.854397 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260812 00:32:30.855811 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.844018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:33049 (local address 127.29.190.131:33471)
0812 00:32:30.845018 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:30.845068 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:30.846943 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:30.848001 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:30.848013 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:30.848134 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:30.848982 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.849011 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.850134 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.850148 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.851687 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.851701 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.852517 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.852525 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.852761 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.853517 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:30.853520 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:30.853560 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:30.853637 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:30.854069 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:30.854081 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:30.854090 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 00:32:30.854286 (+ 196us) client_negotiation.cc:240] Negotiation successful
0812 00:32:30.854699 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":340,"threads_started":1}
I20260812 00:32:30.857380 26056 heartbeater.cc:347] Connected to a master server at 127.29.190.190:33049
I20260812 00:32:30.857725 26056 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:30.858536 26056 heartbeater.cc:511] Master 127.29.190.190:33049 requested a full tablet report, sending...
I20260812 00:32:30.860083 25317 ts_manager.cc:194] Registered new tserver with Master: 103d4b08dd284762a49be87472f97226 (127.29.190.131:36135)
I20260812 00:32:30.860909 25317 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.131:33471
I20260812 00:32:30.863816 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:32:30.872825 25622 heartbeater.cc:503] Master 127.29.190.190:33049 was elected leader, sending a full tablet report...
I20260812 00:32:30.874330 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.867993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34080 (local address 127.29.190.190:33049)
0812 00:32:30.868253 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:30.868260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:30.868553 (+ 293us) server_negotiation.cc:407] Connection header received
0812 00:32:30.868759 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:30.868763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:30.868822 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:30.868922 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:30.869436 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.870162 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.871788 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.872231 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.872368 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.873552 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:30.873579 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:30.873584 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:30.873608 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:30.873648 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:30.873665 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:30.873758 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:30.873911 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 00:32:30.874000 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:32:30.878156 25317 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:32:30.885155 25317 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:32:30.908885 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.898298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59430 (local address 127.29.190.130:43897)
0812 00:32:30.898977 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:30.898987 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:30.899237 (+ 250us) server_negotiation.cc:407] Connection header received
0812 00:32:30.899609 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:30.899619 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:30.899906 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:30.900112 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:30.901156 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.903462 (+ 2306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.906121 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.907670 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.907857 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.908106 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:30.908354 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 00:32:30.908549 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":391,"threads_started":1}
I20260812 00:32:30.909888 26075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.898092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:43897 (local address 127.0.0.1:59430)
0812 00:32:30.899067 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:30.899110 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:30.899294 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:30.900418 (+ 1124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:30.900439 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:30.900478 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:30.900901 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.900921 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.903617 (+ 2696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.903624 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.905844 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.905857 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.907867 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.907875 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.908090 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.908143 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 00:32:30.908291 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 00:32:30.908493 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":578,"threads_started":1}
I20260812 00:32:30.910460 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.899530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:36135 (local address 127.0.0.1:59036)
0812 00:32:30.900071 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:30.900092 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:30.900224 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:30.903013 (+ 2789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:30.903019 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:30.903046 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:30.903424 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.903464 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.905391 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.905396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.907701 (+ 2305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.907717 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.909566 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.909573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.909754 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.909863 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 00:32:30.909946 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:32:30.910083 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":36,"thread_start_us":250,"threads_started":1}
I20260812 00:32:30.910725 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.899852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59036 (local address 127.29.190.131:36135)
0812 00:32:30.902369 (+ 2517us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:30.902380 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:30.902418 (+ 38us) server_negotiation.cc:407] Connection header received
0812 00:32:30.902520 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:30.902528 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:30.902779 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:30.902991 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:30.903675 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.905239 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.907919 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.909328 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.909575 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.909771 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:30.910175 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 00:32:30.910346 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2320,"thread_start_us":2164,"threads_started":1}
I20260812 00:32:30.910938 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.900152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:37613 (local address 127.0.0.1:51194)
0812 00:32:30.901602 (+ 1450us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:30.901624 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:30.901757 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:30.903313 (+ 1556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:30.903321 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:30.903348 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:30.903894 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.903907 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.905844 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.905849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.907405 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:30.907418 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.909731 (+ 2313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.909737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:30.910305 (+ 568us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.910338 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:32:30.910436 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 00:32:30.910594 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1294,"mutex_wait_us":50,"thread_start_us":806,"threads_started":1}
I20260812 00:32:30.911811 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:30.900727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51194 (local address 127.29.190.129:37613)
0812 00:32:30.902664 (+ 1937us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:30.902672 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:30.902698 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:32:30.902786 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:30.902793 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:30.903024 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:30.903207 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:30.904119 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.905687 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.907665 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:30.909175 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:30.909381 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:30.909592 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:30.911262 (+ 1670us) server_negotiation.cc:299] Negotiation successful
0812 00:32:30.911411 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1762,"thread_start_us":1628,"threads_started":1}
I20260812 00:32:30.914140 25735 tablet_service.cc:1467] Processing CreateTablet for tablet 19975ef74bee4e648d5eab4c27e36f67 (DEFAULT_TABLE table=test-table [id=57e895479490466dbad8992f89a604d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:30.914160 25953 tablet_service.cc:1467] Processing CreateTablet for tablet 19975ef74bee4e648d5eab4c27e36f67 (DEFAULT_TABLE table=test-table [id=57e895479490466dbad8992f89a604d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:30.915728 25953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19975ef74bee4e648d5eab4c27e36f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:30.915773 25735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19975ef74bee4e648d5eab4c27e36f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:30.915244 25513 tablet_service.cc:1467] Processing CreateTablet for tablet 19975ef74bee4e648d5eab4c27e36f67 (DEFAULT_TABLE table=test-table [id=57e895479490466dbad8992f89a604d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:30.916635 25513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19975ef74bee4e648d5eab4c27e36f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:30.928485 26085 tablet_bootstrap.cc:492] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Bootstrap starting.
I20260812 00:32:30.930562 26087 tablet_bootstrap.cc:492] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Bootstrap starting.
I20260812 00:32:30.932024 26085 tablet_bootstrap.cc:654] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:30.932217 26088 tablet_bootstrap.cc:492] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Bootstrap starting.
I20260812 00:32:30.933446 26085 log.cc:824] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:30.934300 26087 tablet_bootstrap.cc:654] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:30.935487 26087 log.cc:824] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:30.935616 26088 tablet_bootstrap.cc:654] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:30.936789 26088 log.cc:824] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:30.937860 26085 tablet_bootstrap.cc:492] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: No bootstrap required, opened a new log
I20260812 00:32:30.938220 26085 ts_tablet_manager.cc:1397] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.002s
I20260812 00:32:30.941557 26088 tablet_bootstrap.cc:492] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: No bootstrap required, opened a new log
I20260812 00:32:30.941833 26088 ts_tablet_manager.cc:1397] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260812 00:32:30.946122 26087 tablet_bootstrap.cc:492] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: No bootstrap required, opened a new log
I20260812 00:32:30.946384 26087 ts_tablet_manager.cc:1397] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.007s
I20260812 00:32:30.949601 26088 raft_consensus.cc:348] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:30.949975 26088 raft_consensus.cc:374] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:30.950083 26088 raft_consensus.cc:729] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c549c897f344378c083648d4cd81ba, State: Initialized, Role: FOLLOWER
I20260812 00:32:30.950734 26088 consensus_queue.cc:260] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:30.951294 26085 raft_consensus.cc:348] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:30.951800 26085 raft_consensus.cc:374] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:30.951917 26085 raft_consensus.cc:729] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 103d4b08dd284762a49be87472f97226, State: Initialized, Role: FOLLOWER
I20260812 00:32:30.952505 26085 consensus_queue.cc:260] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:30.953776 26088 ts_tablet_manager.cc:1428] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260812 00:32:30.956290 26056 heartbeater.cc:503] Master 127.29.190.190:33049 was elected leader, sending a full tablet report...
I20260812 00:32:30.956974 26085 ts_tablet_manager.cc:1428] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Time spent starting tablet: real 0.019s user 0.009s sys 0.006s
I20260812 00:32:30.957157 26087 raft_consensus.cc:348] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:30.957731 26087 raft_consensus.cc:374] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:30.957887 26087 raft_consensus.cc:729] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5d12fcac6544ca8cfc9a22e0d95471, State: Initialized, Role: FOLLOWER
I20260812 00:32:30.958541 26087 consensus_queue.cc:260] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:30.959658 25846 heartbeater.cc:503] Master 127.29.190.190:33049 was elected leader, sending a full tablet report...
I20260812 00:32:30.960489 26087 ts_tablet_manager.cc:1428] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Time spent starting tablet: real 0.014s user 0.010s sys 0.005s
W20260812 00:32:31.092353 26057 tablet.cc:2369] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:32:31.098141 25623 tablet.cc:2369] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:32:31.103602 25847 tablet.cc:2369] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:31.125370 26099 raft_consensus.cc:482] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:31.125742 26099 raft_consensus.cc:504] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:31.127586 26099 leader_election.cc:288] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 103d4b08dd284762a49be87472f97226 (127.29.190.131:36135), 06c549c897f344378c083648d4cd81ba (127.29.190.129:37613)
I20260812 00:32:31.135407 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:31.127975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:50141 (local address 127.29.190.131:36135)
0812 00:32:31.128235 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:31.128244 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:31.128839 (+ 595us) server_negotiation.cc:407] Connection header received
0812 00:32:31.129090 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:31.129098 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:31.129215 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:31.129325 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:31.130133 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.131130 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.133383 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.134327 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.134507 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:31.134574 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:31.135027 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 00:32:31.135158 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:32:31.135609 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:31.129075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:41445 (local address 127.29.190.129:37613)
0812 00:32:31.129304 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:31.129313 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:31.129655 (+ 342us) server_negotiation.cc:407] Connection header received
0812 00:32:31.129804 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:31.129812 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:31.129931 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:31.130055 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:31.130749 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.131802 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.133661 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.134594 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.134767 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:31.134832 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:31.135207 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 00:32:31.135335 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:32:31.135659 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:31.128894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:37613 (local address 127.29.190.130:41445)
0812 00:32:31.129544 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:31.129559 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:31.129674 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:31.130127 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:31.130132 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:31.130159 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:31.130567 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:31.130579 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.131945 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.131949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:31.133400 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:31.133415 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.134825 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.134832 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:31.135040 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:31.135065 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 00:32:31.135177 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 00:32:31.135307 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":421,"threads_started":1}
I20260812 00:32:31.136287 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:31.127980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:36135 (local address 127.29.190.130:50141)
0812 00:32:31.128713 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:31.128730 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:31.128925 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:31.129427 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:31.129432 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:31.129467 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:31.129952 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:31.129969 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.131280 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.131285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:31.133170 (+ 1885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:31.133183 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.134562 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.134569 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:31.134770 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:31.134808 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:32:31.135847 (+ 1039us) client_negotiation.cc:240] Negotiation successful
0812 00:32:31.135977 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":4,"thread_start_us":419,"threads_started":1}
I20260812 00:32:31.137334 25543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19975ef74bee4e648d5eab4c27e36f67" candidate_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c549c897f344378c083648d4cd81ba" is_pre_election: true
I20260812 00:32:31.137534 25984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19975ef74bee4e648d5eab4c27e36f67" candidate_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "103d4b08dd284762a49be87472f97226" is_pre_election: true
I20260812 00:32:31.137948 25543 raft_consensus.cc:2454] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5d12fcac6544ca8cfc9a22e0d95471 in term 0.
I20260812 00:32:31.138090 25984 raft_consensus.cc:2454] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5d12fcac6544ca8cfc9a22e0d95471 in term 0.
I20260812 00:32:31.138715 25667 leader_election.cc:302] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c549c897f344378c083648d4cd81ba, 1c5d12fcac6544ca8cfc9a22e0d95471; no voters:
I20260812 00:32:31.139132 26099 raft_consensus.cc:2781] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:32:31.139288 26099 raft_consensus.cc:482] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:32:31.139420 26099 raft_consensus.cc:3037] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:31.141701 26099 raft_consensus.cc:504] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:31.142304 26099 leader_election.cc:288] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [CANDIDATE]: Term 1 election: Requested vote from peers 103d4b08dd284762a49be87472f97226 (127.29.190.131:36135), 06c549c897f344378c083648d4cd81ba (127.29.190.129:37613)
I20260812 00:32:31.142843 25984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19975ef74bee4e648d5eab4c27e36f67" candidate_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "103d4b08dd284762a49be87472f97226"
I20260812 00:32:31.142913 25543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19975ef74bee4e648d5eab4c27e36f67" candidate_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c549c897f344378c083648d4cd81ba"
I20260812 00:32:31.143054 25984 raft_consensus.cc:3037] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:31.143193 25543 raft_consensus.cc:3037] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:31.145555 25543 raft_consensus.cc:2454] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5d12fcac6544ca8cfc9a22e0d95471 in term 1.
I20260812 00:32:31.145574 25984 raft_consensus.cc:2454] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5d12fcac6544ca8cfc9a22e0d95471 in term 1.
I20260812 00:32:31.145988 25667 leader_election.cc:302] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c549c897f344378c083648d4cd81ba, 1c5d12fcac6544ca8cfc9a22e0d95471; no voters:
I20260812 00:32:31.146270 26099 raft_consensus.cc:2781] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:31.146772 26099 raft_consensus.cc:686] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5d12fcac6544ca8cfc9a22e0d95471, State: Running, Role: LEADER
I20260812 00:32:31.147359 26099 consensus_queue.cc:237] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } }
I20260812 00:32:31.152105 25316 catalog_manager.cc:5495] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5d12fcac6544ca8cfc9a22e0d95471 (127.29.190.130). New cstate: current_term: 1 leader_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5d12fcac6544ca8cfc9a22e0d95471" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 43897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 } health_report { overall_health: UNKNOWN } } }
I20260812 00:32:31.205575 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:31.199818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59442 (local address 127.29.190.130:43897)
0812 00:32:31.200070 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:31.200077 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:31.200176 (+ 99us) server_negotiation.cc:407] Connection header received
0812 00:32:31.200443 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:31.200447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:31.200544 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:31.200705 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:32:31.201105 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.201820 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.203254 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.203701 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.203845 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:31.204352 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:32:31.204960 (+ 608us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:32:31.205132 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:31.205210 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 00:32:31.205295 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:32:31.214330 25984 raft_consensus.cc:1261] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 1 FOLLOWER]: Refusing update from remote peer 1c5d12fcac6544ca8cfc9a22e0d95471: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:31.214330 25543 raft_consensus.cc:1261] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 1 FOLLOWER]: Refusing update from remote peer 1c5d12fcac6544ca8cfc9a22e0d95471: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:31.215556 26104 consensus_queue.cc:1035] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [LEADER]: Connected to new peer: Peer: permanent_uuid: "103d4b08dd284762a49be87472f97226" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:31.215937 26099 consensus_queue.cc:1035] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c549c897f344378c083648d4cd81ba" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 37613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:31.227910 26107 mvcc.cc:205] Tried to move back new op lower bound from 7317482500963037184 to 7317482500703875072. Current Snapshot: MvccSnapshot[applied={T|T < 7317482500963037184}]
I20260812 00:32:31.229665 26108 mvcc.cc:205] Tried to move back new op lower bound from 7317482500963037184 to 7317482500703875072. Current Snapshot: MvccSnapshot[applied={T|T < 7317482500963037184}]
I20260812 00:32:31.242866 25316 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:31.243216 25316 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:31.247272 25316 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0467756dad644ad09d6c41c3f4223ca1: Sending DeleteTablet for 3 replicas of tablet 19975ef74bee4e648d5eab4c27e36f67
I20260812 00:32:31.248584 25735 tablet_service.cc:1514] Processing DeleteTablet for tablet 19975ef74bee4e648d5eab4c27e36f67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:31 UTC) from {username='slave'} at 127.0.0.1:59430
I20260812 00:32:31.249138 25953 tablet_service.cc:1514] Processing DeleteTablet for tablet 19975ef74bee4e648d5eab4c27e36f67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:31 UTC) from {username='slave'} at 127.0.0.1:59036
I20260812 00:32:31.249363 25513 tablet_service.cc:1514] Processing DeleteTablet for tablet 19975ef74bee4e648d5eab4c27e36f67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:31 UTC) from {username='slave'} at 127.0.0.1:51194
I20260812 00:32:31.249605 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 25415
I20260812 00:32:31.274725 26124 tablet_replica.cc:330] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: stopping tablet replica
I20260812 00:32:31.275609 26124 raft_consensus.cc:2229] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:31.276443 26122 tablet_replica.cc:330] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: stopping tablet replica
I20260812 00:32:31.277127 26124 raft_consensus.cc:2258] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:31.277678 26122 raft_consensus.cc:2229] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:32:31.278728 26122 raft_consensus.cc:2258] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:31.280958 26124 ts_tablet_manager.cc:1905] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:31.283277 26122 ts_tablet_manager.cc:1905] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:31.288811 26124 ts_tablet_manager.cc:1918] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:31.289081 26124 log.cc:1196] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/19975ef74bee4e648d5eab4c27e36f67
I20260812 00:32:31.289774 26124 ts_tablet_manager.cc:1939] T 19975ef74bee4e648d5eab4c27e36f67 P 06c549c897f344378c083648d4cd81ba: Deleting consensus metadata
I20260812 00:32:31.292269 26123 tablet_replica.cc:330] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: stopping tablet replica
I20260812 00:32:31.292825 26123 raft_consensus.cc:2229] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:31.293232 26122 ts_tablet_manager.cc:1918] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:31.293452 26123 raft_consensus.cc:2258] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:31.293517 26122 log.cc:1196] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/19975ef74bee4e648d5eab4c27e36f67
I20260812 00:32:31.294154 25295 catalog_manager.cc:4841] TS 06c549c897f344378c083648d4cd81ba (127.29.190.129:37613): tablet 19975ef74bee4e648d5eab4c27e36f67 (table test-table [id=57e895479490466dbad8992f89a604d5]) successfully deleted
I20260812 00:32:31.294754 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:31.251044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51206 (local address 127.29.190.129:37613)
0812 00:32:31.251257 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:31.251266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:31.276154 (+ 24888us) server_negotiation.cc:407] Connection header received
0812 00:32:31.276732 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:31.276738 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:31.276835 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:31.276915 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:31.287198 (+ 10283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.288423 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.290608 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.291211 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.291314 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:31.292982 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:31.292992 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:31.293009 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:31.293786 (+ 777us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:31.293856 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:31.293884 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:31.293974 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:31.294258 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 00:32:31.294379 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:32:31.296149 25612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:31.296169 26122 ts_tablet_manager.cc:1939] T 19975ef74bee4e648d5eab4c27e36f67 P 1c5d12fcac6544ca8cfc9a22e0d95471: Deleting consensus metadata
I20260812 00:32:31.296162 26123 ts_tablet_manager.cc:1905] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:31.297932 25295 catalog_manager.cc:4841] TS 1c5d12fcac6544ca8cfc9a22e0d95471 (127.29.190.130:43897): tablet 19975ef74bee4e648d5eab4c27e36f67 (table test-table [id=57e895479490466dbad8992f89a604d5]) successfully deleted
I20260812 00:32:31.306535 26123 ts_tablet_manager.cc:1918] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:31.306759 26123 log.cc:1196] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/19975ef74bee4e648d5eab4c27e36f67
I20260812 00:32:31.307360 26123 ts_tablet_manager.cc:1939] T 19975ef74bee4e648d5eab4c27e36f67 P 103d4b08dd284762a49be87472f97226: Deleting consensus metadata
I20260812 00:32:31.309433 25295 catalog_manager.cc:4841] TS 103d4b08dd284762a49be87472f97226 (127.29.190.131:36135): tablet 19975ef74bee4e648d5eab4c27e36f67 (table test-table [id=57e895479490466dbad8992f89a604d5]) successfully deleted
I20260812 00:32:31.416734 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 25415
I20260812 00:32:31.453512 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 25628
I20260812 00:32:31.462157 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:31.454335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59450 (local address 127.29.190.130:43897)
0812 00:32:31.454528 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:31.454535 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:31.454615 (+ 80us) server_negotiation.cc:407] Connection header received
0812 00:32:31.454852 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:31.454857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:31.454938 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:31.455090 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:31.455890 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.456784 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.458433 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.458915 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.459086 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:31.460439 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:31.460451 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:31.460467 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:31.461232 (+ 765us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:31.461285 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:31.461316 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:31.461460 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:31.461625 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:32:31.461746 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:32:31.462981 25840 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:31.576747 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 25628
I20260812 00:32:31.605475 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 25849
I20260812 00:32:31.612376 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:31.606404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59044 (local address 127.29.190.131:36135)
0812 00:32:31.606610 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:31.606614 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:31.606669 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:32:31.606823 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:31.606827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:31.606912 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:31.607008 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:31.607378 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.608159 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.609450 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:31.609830 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:31.609918 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:31.610967 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:31.610975 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:31.610989 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:31.611631 (+ 642us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:31.611678 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:31.611699 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:31.611792 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:31.611931 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 00:32:31.612026 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 00:32:31.613015 26042 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:31.712332 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 25849
I20260812 00:32:31.736786 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 25276
I20260812 00:32:31.738013 25366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:31.848487 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 25276
2026-08-12T00:32:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3171 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:31 dist-test-slave-c12x krb5kdc[26134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:31 dist-test-slave-c12x krb5kdc[26134](info): set up 2 sockets
Aug 12 00:32:31 dist-test-slave-c12x krb5kdc[26134](info): commencing operation
krb5kdc: starting...
W20260812 00:32:33.189043 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:32:33 dist-test-slave-c12x krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:32:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:32:33.503126 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46217
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:46217
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:33.876436 26154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:33.876791 26154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:33.877012 26154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:33.884654 26154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:33.884773 26154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:33.884877 26154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:33.884979 26154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:33.885085 26154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:33.895354 26154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:46217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:46217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:33.896858 26154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:33.898237 26154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:33.911275 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:33.911340 26168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:33.911302 26170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:33.912230 26154 server_base.cc:1034] running on GCE node
I20260812 00:32:33.913158 26154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:33.914824 26154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:33.916070 26154 hybrid_clock.cc:648] HybridClock initialized: now 1786494753916005 us; error 67 us; skew 500 ppm
I20260812 00:32:33.916532 26154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:33 dist-test-slave-c12x krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494753, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:33.920533 26154 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:32:33.922358 26154 webserver.cc:460] Webserver started at http://127.29.190.190:44089/ using document root <none> and password file <none>
I20260812 00:32:33.923169 26154 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:33.923341 26154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:33.923718 26154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:33.926982 26154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "aaa196ab49a248d9a452fa726a06df7d"
format_stamp: "Formatted at 2026-08-12 00:32:33 on dist-test-slave-c12x"
server_key: "a2b78c599852f1ce2c563789a65b17d7"
server_key_iv: "ee72595255748efbed17904b918e2915"
server_key_version: "encryptionkey@0"
I20260812 00:32:33.927891 26154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "aaa196ab49a248d9a452fa726a06df7d"
format_stamp: "Formatted at 2026-08-12 00:32:33 on dist-test-slave-c12x"
server_key: "a2b78c599852f1ce2c563789a65b17d7"
server_key_iv: "ee72595255748efbed17904b918e2915"
server_key_version: "encryptionkey@0"
I20260812 00:32:33.933634 26154 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:32:33.937719 26179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:33.939419 26154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:32:33.939742 26154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "aaa196ab49a248d9a452fa726a06df7d"
format_stamp: "Formatted at 2026-08-12 00:32:33 on dist-test-slave-c12x"
server_key: "a2b78c599852f1ce2c563789a65b17d7"
server_key_iv: "ee72595255748efbed17904b918e2915"
server_key_version: "encryptionkey@0"
I20260812 00:32:33.939985 26154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:33.966588 26154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:33.970989 26154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:33.971325 26154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:33.991124 26154 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:46217
I20260812 00:32:33.991144 26264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:46217 every 8 connection(s)
I20260812 00:32:33.992626 26154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:33.995263 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 26154
I20260812 00:32:33.995496 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:33.996096 30458 external_mini_cluster.cc:1428] Setting key 889da673b278dbe4067c1da38c713dfd
I20260812 00:32:33.997308 26265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:34.012236 26265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d: Bootstrap starting.
Aug 12 00:32:34 dist-test-slave-c12x krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:34.016356 26265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:34.017748 26265 log.cc:824] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:34.021497 26265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d: No bootstrap required, opened a new log
I20260812 00:32:34.023164 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:33.998313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54206 (local address 127.29.190.190:46217)
0812 00:32:33.999290 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:33.999306 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:33.999723 (+ 417us) server_negotiation.cc:407] Connection header received
0812 00:32:34.002086 (+ 2363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:34.002115 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:34.002664 (+ 549us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:34.003148 (+ 484us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:34.004689 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:34.006725 (+ 2036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:34.008265 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:34.009429 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:34.009647 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:34.013986 (+ 4339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:34.013999 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:34.014021 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:34.014079 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:34.018188 (+ 4109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:34.019146 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:34.019153 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:34.019160 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:34.019411 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:34.019880 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:34.019885 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:34.019888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:34.020623 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:34.020944 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:34.021287 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 00:32:34.021766 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":404,"threads_started":1}
I20260812 00:32:34.030257 26265 raft_consensus.cc:348] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa196ab49a248d9a452fa726a06df7d" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46217 } }
I20260812 00:32:34.030622 26265 raft_consensus.cc:374] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:34.030702 26265 raft_consensus.cc:729] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaa196ab49a248d9a452fa726a06df7d, State: Initialized, Role: FOLLOWER
I20260812 00:32:34.031272 26265 consensus_queue.cc:260] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa196ab49a248d9a452fa726a06df7d" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46217 } }
I20260812 00:32:34.031555 26265 raft_consensus.cc:388] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:34.031713 26265 raft_consensus.cc:482] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:34.031908 26265 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:34.034372 26265 raft_consensus.cc:504] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa196ab49a248d9a452fa726a06df7d" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46217 } }
I20260812 00:32:34.034850 26265 leader_election.cc:302] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aaa196ab49a248d9a452fa726a06df7d; no voters:
I20260812 00:32:34.035480 26265 leader_election.cc:288] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:34.035671 26273 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:34.036939 26273 raft_consensus.cc:686] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [term 1 LEADER]: Becoming Leader. State: Replica: aaa196ab49a248d9a452fa726a06df7d, State: Running, Role: LEADER
I20260812 00:32:34.037631 26273 consensus_queue.cc:237] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa196ab49a248d9a452fa726a06df7d" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46217 } }
I20260812 00:32:34.037873 26265 sys_catalog.cc:564] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:34.040678 26276 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader aaa196ab49a248d9a452fa726a06df7d. Latest consensus state: current_term: 1 leader_uuid: "aaa196ab49a248d9a452fa726a06df7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa196ab49a248d9a452fa726a06df7d" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46217 } } }
I20260812 00:32:34.041078 26276 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:34.041410 26275 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aaa196ab49a248d9a452fa726a06df7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaa196ab49a248d9a452fa726a06df7d" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 46217 } } }
I20260812 00:32:34.041811 26275 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:34.043236 26286 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:34.049144 26286 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:34.057602 26286 catalog_manager.cc:1347] Generated new cluster ID: 2dd756328b4f41be8eb51b3d2f686e34
I20260812 00:32:34.057725 26286 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:34.077311 26286 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:34.078819 26286 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:34.085816 26286 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d: Generated new TSK 0
I20260812 00:32:34.086690 26286 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:32:34.176695 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46217
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:34.540987 26322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:34.541270 26322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:34.541427 26322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:34.549132 26322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:34.549266 26322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:34.549450 26322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:32:34.559289 26322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:34.560647 26322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:34.561970 26322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:34.575788 26334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:34.576035 26336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:34.575766 26333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:34.577111 26322 server_base.cc:1034] running on GCE node
I20260812 00:32:34.577808 26322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:34.578889 26322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:34.580132 26322 hybrid_clock.cc:648] HybridClock initialized: now 1786494754580075 us; error 50 us; skew 500 ppm
I20260812 00:32:34.580484 26322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:34 dist-test-slave-c12x krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494754, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:34.588878 26322 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:32:34.590631 26322 webserver.cc:460] Webserver started at http://127.29.190.129:35567/ using document root <none> and password file <none>
I20260812 00:32:34.591408 26322 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:34.591639 26322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:34.592001 26322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:34.595074 26322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "c597adf944274a0b851be6a411bc045d"
format_stamp: "Formatted at 2026-08-12 00:32:34 on dist-test-slave-c12x"
server_key: "78ef7587819d6a5bfde886f154218ade"
server_key_iv: "cb29945f15e2a714ad0e1e11c72fd5a8"
server_key_version: "encryptionkey@0"
I20260812 00:32:34.595901 26322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "c597adf944274a0b851be6a411bc045d"
format_stamp: "Formatted at 2026-08-12 00:32:34 on dist-test-slave-c12x"
server_key: "78ef7587819d6a5bfde886f154218ade"
server_key_iv: "cb29945f15e2a714ad0e1e11c72fd5a8"
server_key_version: "encryptionkey@0"
I20260812 00:32:34.601372 26322 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 00:32:34.604816 26344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:34.606153 26322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 00:32:34.606441 26322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "c597adf944274a0b851be6a411bc045d"
format_stamp: "Formatted at 2026-08-12 00:32:34 on dist-test-slave-c12x"
server_key: "78ef7587819d6a5bfde886f154218ade"
server_key_iv: "cb29945f15e2a714ad0e1e11c72fd5a8"
server_key_version: "encryptionkey@0"
I20260812 00:32:34.606666 26322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:34.634701 26322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:34.639573 26322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:34.639884 26322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:34.640944 26322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:34.642367 26322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:34.642478 26322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:34.642645 26322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:34.642721 26322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:34.677987 26322 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:34699
I20260812 00:32:34.678056 26527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:34699 every 8 connection(s)
I20260812 00:32:34.679386 26322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:32:34.679816 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 26322
I20260812 00:32:34.680034 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:32:34.680676 30458 external_mini_cluster.cc:1428] Setting key 52c55fadabb74071d7c2acdb7e0ba0f4
Aug 12 00:32:34 dist-test-slave-c12x krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494754, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:34.702504 26533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:34.682423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:52821 (local address 127.29.190.190:46217)
0812 00:32:34.683105 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:34.683111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:34.684227 (+ 1116us) server_negotiation.cc:407] Connection header received
0812 00:32:34.686124 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:34.686133 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:34.686226 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:34.686350 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:34.687968 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:34.689138 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:34.690748 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:34.691529 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:34.691684 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:34.695683 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:34.695688 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:34.695692 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:34.695728 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:34.698357 (+ 2629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:34.699417 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:34.699421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:34.699424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:34.699627 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:34.700248 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:34.700252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:34.700254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:34.700603 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:34.700746 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:34.701860 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0812 00:32:34.702085 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":442,"threads_started":1}
I20260812 00:32:34.704020 26534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:34.683111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46217 (local address 127.29.190.129:52821)
0812 00:32:34.684055 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:34.684103 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:34.685849 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:34.686580 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:34.686588 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:34.687134 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:34.687791 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:34.687810 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:34.689291 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:34.689295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:34.690593 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:34.690606 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:34.691787 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:34.691792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:34.692013 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:34.692780 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:34.692803 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:34.695396 (+ 2593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:34.698544 (+ 3148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:34.698560 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:34.698586 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:34.699286 (+ 700us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:34.699743 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:34.699750 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:34.699757 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:34.700083 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:34.700765 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:34.700776 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:34.701307 (+ 531us) client_negotiation.cc:769] Sending connection context
0812 00:32:34.701695 (+ 388us) client_negotiation.cc:240] Negotiation successful
0812 00:32:34.702356 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":424,"threads_started":1}
I20260812 00:32:34.705861 26528 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46217
I20260812 00:32:34.706297 26528 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:34.707233 26528 heartbeater.cc:511] Master 127.29.190.190:46217 requested a full tablet report, sending...
I20260812 00:32:34.709935 26211 ts_manager.cc:194] Registered new tserver with Master: c597adf944274a0b851be6a411bc045d (127.29.190.129:34699)
I20260812 00:32:34.712225 26211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:52821
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:32:34.755076 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46217
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:35.099283 26538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:35.099630 26538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:35.099738 26538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:35.107010 26538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:35.107117 26538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:35.107292 26538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:32:35.117354 26538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:35.118762 26538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:35.120129 26538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:35.133890 26546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:35.133860 26548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:35.133924 26545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:35.134758 26538 server_base.cc:1034] running on GCE node
I20260812 00:32:35.135474 26538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:35.136566 26538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:35.137809 26538 hybrid_clock.cc:648] HybridClock initialized: now 1786494755137759 us; error 38 us; skew 500 ppm
I20260812 00:32:35.138166 26538 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:35 dist-test-slave-c12x krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494755, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:35.141578 26538 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:32:35.143201 26538 webserver.cc:460] Webserver started at http://127.29.190.130:44477/ using document root <none> and password file <none>
I20260812 00:32:35.144196 26538 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:35.144348 26538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:35.144863 26538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:35.148432 26538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e"
format_stamp: "Formatted at 2026-08-12 00:32:35 on dist-test-slave-c12x"
server_key: "ce71dac2954c0f46d2fa8cb308522a8f"
server_key_iv: "a3bc13723ec20c66b09a1192bdfd03c6"
server_key_version: "encryptionkey@0"
I20260812 00:32:35.149323 26538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e"
format_stamp: "Formatted at 2026-08-12 00:32:35 on dist-test-slave-c12x"
server_key: "ce71dac2954c0f46d2fa8cb308522a8f"
server_key_iv: "a3bc13723ec20c66b09a1192bdfd03c6"
server_key_version: "encryptionkey@0"
I20260812 00:32:35.154966 26538 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:32:35.158876 26559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:35.160315 26538 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:32:35.160494 26538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e"
format_stamp: "Formatted at 2026-08-12 00:32:35 on dist-test-slave-c12x"
server_key: "ce71dac2954c0f46d2fa8cb308522a8f"
server_key_iv: "a3bc13723ec20c66b09a1192bdfd03c6"
server_key_version: "encryptionkey@0"
I20260812 00:32:35.160719 26538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:35.185418 26538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:35.190335 26538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:35.190681 26538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:35.191815 26538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:35.193224 26538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:35.193300 26538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:35.193487 26538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:35.193557 26538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:35.228118 26538 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:37847
I20260812 00:32:35.228212 26744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:37847 every 8 connection(s)
I20260812 00:32:35.229502 26538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:32:35.236853 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 26538
I20260812 00:32:35.237066 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:32:35.237618 30458 external_mini_cluster.cc:1428] Setting key e45bf0e8bf66256cf8d0a699227800a5
Aug 12 00:32:35 dist-test-slave-c12x krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494755, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:35.252867 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.232068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:35017 (local address 127.29.190.190:46217)
0812 00:32:35.232556 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:35.232561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:35.233386 (+ 825us) server_negotiation.cc:407] Connection header received
0812 00:32:35.235259 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:35.235267 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:35.235366 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:35.235520 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:35.237343 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.238222 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.240365 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.241090 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.241237 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.245396 (+ 4159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:35.245405 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:35.245412 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:35.245459 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:35.249301 (+ 3842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:35.250090 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:35.250098 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:35.250105 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:35.250271 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:35.250705 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:35.250712 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:35.250718 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:35.251129 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:35.251285 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:35.252070 (+ 785us) server_negotiation.cc:299] Negotiation successful
0812 00:32:35.252338 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":259,"threads_started":1}
I20260812 00:32:35.253609 26749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.232476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46217 (local address 127.29.190.130:35017)
0812 00:32:35.233213 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:35.233259 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:35.234970 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:35.235760 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:35.235768 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:35.236291 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:35.237136 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.237167 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.238391 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.238399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.240197 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.240210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.241321 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.241326 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.241551 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.242279 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:35.242301 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:35.245100 (+ 2799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:35.249453 (+ 4353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:35.249460 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:35.249475 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:35.249947 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:35.250382 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:35.250385 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:35.250387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:35.250575 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:35.251253 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:35.251259 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:35.251673 (+ 414us) client_negotiation.cc:769] Sending connection context
0812 00:32:35.251908 (+ 235us) client_negotiation.cc:240] Negotiation successful
0812 00:32:35.252322 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":284,"threads_started":1}
I20260812 00:32:35.255234 26745 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46217
I20260812 00:32:35.255640 26745 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:35.256366 26745 heartbeater.cc:511] Master 127.29.190.190:46217 requested a full tablet report, sending...
I20260812 00:32:35.257874 26211 ts_manager.cc:194] Registered new tserver with Master: 5ec46f68ce4e4c41b0c5640bb7cc8b9e (127.29.190.130:37847)
I20260812 00:32:35.258702 26211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:35017
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:32:35.310806 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46217
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:35.664638 26753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:35.664940 26753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:35.665097 26753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:35.672614 26753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:35.672734 26753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:35.672850 26753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:32:35.683296 26753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:46217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:35.684613 26753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:35.685951 26753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:35.701179 26762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:35.701175 26760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:35.701624 26758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:35.702201 26753 server_base.cc:1034] running on GCE node
I20260812 00:32:35.702955 26753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:35.704118 26753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:35.705359 26753 hybrid_clock.cc:648] HybridClock initialized: now 1786494755705314 us; error 47 us; skew 500 ppm
I20260812 00:32:35.705729 26753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:35 dist-test-slave-c12x krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494755, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:35.709187 26753 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:32:35.710799 26753 webserver.cc:460] Webserver started at http://127.29.190.131:35123/ using document root <none> and password file <none>
I20260812 00:32:35.711627 26753 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:35.711782 26753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:35.712133 26753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:35.715219 26753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "0c7ae1c2f59043af98de8a0c27c39a42"
format_stamp: "Formatted at 2026-08-12 00:32:35 on dist-test-slave-c12x"
server_key: "0a95fa1c6d4ca9c9c3661eae214c67b2"
server_key_iv: "ac628d15dd4368fc2436cf6f85ce26bf"
server_key_version: "encryptionkey@0"
I20260812 00:32:35.716075 26753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "0c7ae1c2f59043af98de8a0c27c39a42"
format_stamp: "Formatted at 2026-08-12 00:32:35 on dist-test-slave-c12x"
server_key: "0a95fa1c6d4ca9c9c3661eae214c67b2"
server_key_iv: "ac628d15dd4368fc2436cf6f85ce26bf"
server_key_version: "encryptionkey@0"
I20260812 00:32:35.716498 26528 heartbeater.cc:503] Master 127.29.190.190:46217 was elected leader, sending a full tablet report...
I20260812 00:32:35.722142 26753 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260812 00:32:35.725908 26772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:35.727310 26753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 00:32:35.727543 26753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "0c7ae1c2f59043af98de8a0c27c39a42"
format_stamp: "Formatted at 2026-08-12 00:32:35 on dist-test-slave-c12x"
server_key: "0a95fa1c6d4ca9c9c3661eae214c67b2"
server_key_iv: "ac628d15dd4368fc2436cf6f85ce26bf"
server_key_version: "encryptionkey@0"
I20260812 00:32:35.727767 26753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:35.743011 26753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:35.748351 26753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:35.748621 26753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:35.749651 26753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:35.751052 26753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:35.751128 26753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:35.751298 26753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:35.751375 26753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:35.786505 26753 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:36493
I20260812 00:32:35.786553 26945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:36493 every 8 connection(s)
I20260812 00:32:35.787997 26753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:32:35.792451 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 26753
I20260812 00:32:35.792654 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:32:35.793227 30458 external_mini_cluster.cc:1428] Setting key 20bfd036476683e3e94c34840b664d98
Aug 12 00:32:35 dist-test-slave-c12x krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494755, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:35.809111 26949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.790719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:53863 (local address 127.29.190.190:46217)
0812 00:32:35.791217 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:35.791222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:35.792142 (+ 920us) server_negotiation.cc:407] Connection header received
0812 00:32:35.794240 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:35.794247 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:35.794363 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:35.794490 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:35.796185 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.797139 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.798678 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.799127 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.799235 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.802706 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:35.802711 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:35.802714 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:35.802748 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:35.805497 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:35.806257 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:35.806261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:35.806264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:35.806391 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:35.806891 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:35.806895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:35.806897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:35.807276 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:35.807411 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:35.808407 (+ 996us) server_negotiation.cc:299] Negotiation successful
0812 00:32:35.808660 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":249,"threads_started":1}
I20260812 00:32:35.810037 26950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.791128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:46217 (local address 127.29.190.131:53863)
0812 00:32:35.791917 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:35.791962 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:35.793844 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:35.794774 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:35.794782 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:35.795404 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:35.796013 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.796032 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.797288 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.797292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.798534 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.798546 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.799321 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.799325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.799564 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.800276 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:35.800297 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:35.802472 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:35.805664 (+ 3192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:35.805671 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:35.805685 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:35.806131 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:35.806505 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:35.806508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:35.806511 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:35.806772 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:35.807418 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:35.807425 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:35.807924 (+ 499us) client_negotiation.cc:769] Sending connection context
0812 00:32:35.808245 (+ 321us) client_negotiation.cc:240] Negotiation successful
0812 00:32:35.808768 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":341,"threads_started":1}
I20260812 00:32:35.811561 26946 heartbeater.cc:347] Connected to a master server at 127.29.190.190:46217
I20260812 00:32:35.812444 26946 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:35.813493 26946 heartbeater.cc:511] Master 127.29.190.190:46217 requested a full tablet report, sending...
I20260812 00:32:35.815177 26211 ts_manager.cc:194] Registered new tserver with Master: 0c7ae1c2f59043af98de8a0c27c39a42 (127.29.190.131:36493)
I20260812 00:32:35.816470 26211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:53863
I20260812 00:32:35.821924 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:32:35.841084 26949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.826690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54220 (local address 127.29.190.190:46217)
0812 00:32:35.826908 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:35.826918 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:35.827331 (+ 413us) server_negotiation.cc:407] Connection header received
0812 00:32:35.827614 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:35.827618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:35.827687 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:35.827792 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:35.829279 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.830041 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.831541 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.831985 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.832143 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.835263 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:35.835269 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:35.835272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:35.835309 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:35.837970 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:35.838843 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:35.838850 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:35.838853 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:35.838995 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:35.839524 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:35.839527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:35.839530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:35.839856 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:35.840137 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:35.840584 (+ 447us) server_negotiation.cc:299] Negotiation successful
0812 00:32:35.840786 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:32:35.845548 26211 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:32:35.852757 26211 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:32:35.878165 26968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.865639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:37847 (local address 127.0.0.1:44044)
0812 00:32:35.868582 (+ 2943us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:35.868600 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:35.868717 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:35.869661 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:35.869668 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:35.869694 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:35.870175 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.870189 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.872081 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.872087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.874753 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.874769 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.877012 (+ 2243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.877019 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.877239 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.877296 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 00:32:35.877434 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 00:32:35.877643 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2802,"mutex_wait_us":91,"thread_start_us":2633,"threads_started":1}
I20260812 00:32:35.879201 26973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.866178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44044 (local address 127.29.190.130:37847)
0812 00:32:35.868139 (+ 1961us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:35.868151 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:35.868839 (+ 688us) server_negotiation.cc:407] Connection header received
0812 00:32:35.868957 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:35.868964 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:35.869218 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:35.869429 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:35.870398 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.871894 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.874936 (+ 3042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.876484 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.876646 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.876836 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:35.878713 (+ 1877us) server_negotiation.cc:299] Negotiation successful
0812 00:32:35.878896 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1813,"thread_start_us":1723,"threads_started":1}
I20260812 00:32:35.880051 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.865490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34699 (local address 127.0.0.1:38702)
0812 00:32:35.866188 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:35.866225 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:35.866399 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:35.867911 (+ 1512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:35.867918 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:35.867959 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:35.868516 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.868530 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.871975 (+ 3445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.871981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.875733 (+ 3752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.875748 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.879130 (+ 3382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.879137 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.879322 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.879354 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 00:32:35.879473 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 00:32:35.879643 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":112,"thread_start_us":322,"threads_started":1}
I20260812 00:32:35.880617 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.865775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38702 (local address 127.29.190.129:34699)
0812 00:32:35.867223 (+ 1448us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:35.867230 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:35.867253 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:32:35.867371 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:35.867380 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:35.867664 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:35.867878 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:35.868756 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.871795 (+ 3039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.875932 (+ 4137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.878614 (+ 2682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.878813 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.878975 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:35.879949 (+ 974us) server_negotiation.cc:299] Negotiation successful
0812 00:32:35.880188 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1289,"thread_start_us":1105,"threads_started":1}
I20260812 00:32:35.885066 26417 tablet_service.cc:1467] Processing CreateTablet for tablet 91e34f02dab548d8b32f51763c933058 (DEFAULT_TABLE table=test-table [id=69e0e3cbbe7741cea409eb86c2a80cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:35.886406 26417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91e34f02dab548d8b32f51763c933058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:35.886080 26636 tablet_service.cc:1467] Processing CreateTablet for tablet 91e34f02dab548d8b32f51763c933058 (DEFAULT_TABLE table=test-table [id=69e0e3cbbe7741cea409eb86c2a80cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:35.887549 26636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91e34f02dab548d8b32f51763c933058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:35.887557 26968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.868704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:36493 (local address 127.0.0.1:47938)
0812 00:32:35.878418 (+ 9714us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:35.878439 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:35.878539 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:35.880831 (+ 2292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:35.880836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:35.880861 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:35.881046 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.881054 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.882907 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.882912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.884763 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:35.884778 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.886657 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.886664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:35.886941 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.886974 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 00:32:35.887091 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 00:32:35.887236 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9613,"thread_start_us":13516,"threads_started":1}
I20260812 00:32:35.887739 26976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:35.869048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47938 (local address 127.29.190.131:36493)
0812 00:32:35.879885 (+ 10837us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:35.879896 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:35.879932 (+ 36us) server_negotiation.cc:407] Connection header received
0812 00:32:35.880069 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:35.880080 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:35.880597 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:35.881194 (+ 597us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:35.881406 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.882740 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.884947 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:35.886374 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:35.886579 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:35.886748 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:35.887179 (+ 431us) server_negotiation.cc:299] Negotiation successful
0812 00:32:35.887345 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10653,"thread_start_us":10485,"threads_started":1}
I20260812 00:32:35.892051 26846 tablet_service.cc:1467] Processing CreateTablet for tablet 91e34f02dab548d8b32f51763c933058 (DEFAULT_TABLE table=test-table [id=69e0e3cbbe7741cea409eb86c2a80cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:35.893743 26846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91e34f02dab548d8b32f51763c933058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:35.899426 26979 tablet_bootstrap.cc:492] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Bootstrap starting.
I20260812 00:32:35.902280 26981 tablet_bootstrap.cc:492] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Bootstrap starting.
I20260812 00:32:35.903373 26979 tablet_bootstrap.cc:654] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:35.904830 26979 log.cc:824] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:35.906033 26981 tablet_bootstrap.cc:654] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:35.907331 26981 log.cc:824] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:35.908406 26979 tablet_bootstrap.cc:492] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: No bootstrap required, opened a new log
I20260812 00:32:35.908536 26983 tablet_bootstrap.cc:492] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Bootstrap starting.
I20260812 00:32:35.908834 26979 ts_tablet_manager.cc:1397] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 00:32:35.912806 26983 tablet_bootstrap.cc:654] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:35.912849 26981 tablet_bootstrap.cc:492] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: No bootstrap required, opened a new log
I20260812 00:32:35.913128 26981 ts_tablet_manager.cc:1397] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260812 00:32:35.914113 26983 log.cc:824] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:35.917289 26983 tablet_bootstrap.cc:492] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: No bootstrap required, opened a new log
I20260812 00:32:35.917553 26983 ts_tablet_manager.cc:1397] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 00:32:35.917740 26979 raft_consensus.cc:348] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:35.918207 26979 raft_consensus.cc:374] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:35.918329 26979 raft_consensus.cc:729] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c597adf944274a0b851be6a411bc045d, State: Initialized, Role: FOLLOWER
I20260812 00:32:35.919001 26979 consensus_queue.cc:260] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:35.920630 26979 ts_tablet_manager.cc:1428] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Time spent starting tablet: real 0.012s user 0.006s sys 0.005s
I20260812 00:32:35.923188 26981 raft_consensus.cc:348] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:35.923727 26981 raft_consensus.cc:374] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:35.923846 26981 raft_consensus.cc:729] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec46f68ce4e4c41b0c5640bb7cc8b9e, State: Initialized, Role: FOLLOWER
I20260812 00:32:35.924530 26981 consensus_queue.cc:260] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:35.925755 26745 heartbeater.cc:503] Master 127.29.190.190:46217 was elected leader, sending a full tablet report...
I20260812 00:32:35.926479 26981 ts_tablet_manager.cc:1428] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260812 00:32:35.927773 26983 raft_consensus.cc:348] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:35.928253 26983 raft_consensus.cc:374] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:35.928370 26983 raft_consensus.cc:729] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7ae1c2f59043af98de8a0c27c39a42, State: Initialized, Role: FOLLOWER
I20260812 00:32:35.928902 26983 consensus_queue.cc:260] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:35.930058 26946 heartbeater.cc:503] Master 127.29.190.190:46217 was elected leader, sending a full tablet report...
I20260812 00:32:35.930692 26983 ts_tablet_manager.cc:1428] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260812 00:32:35.932133 26532 tablet.cc:2369] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:32:35.981552 26746 tablet.cc:2369] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:35.998042 26988 raft_consensus.cc:482] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:35.998420 26988 raft_consensus.cc:504] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:36.000386 26988 leader_election.cc:288] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c597adf944274a0b851be6a411bc045d (127.29.190.129:34699), 0c7ae1c2f59043af98de8a0c27c39a42 (127.29.190.131:36493)
I20260812 00:32:36.008951 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:36.001057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:55577 (local address 127.29.190.129:34699)
0812 00:32:36.001355 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:36.001365 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:36.002243 (+ 878us) server_negotiation.cc:407] Connection header received
0812 00:32:36.002649 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:36.002658 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:36.002748 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:36.002849 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:36.003496 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.004434 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.006898 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.008060 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.008231 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:36.008312 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:36.008559 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 00:32:36.008708 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260812 00:32:36.009057 26992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:36.000799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:34699 (local address 127.29.190.130:55577)
0812 00:32:36.002132 (+ 1333us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:36.002159 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:36.002446 (+ 287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:36.002879 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:36.002883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:36.002913 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:36.003291 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:36.003303 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.004577 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.004584 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:36.006725 (+ 2141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:36.006741 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.008264 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.008268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:36.008378 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:36.008403 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 00:32:36.008481 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 00:32:36.008576 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1200,"mutex_wait_us":4,"thread_start_us":1462,"threads_started":1}
I20260812 00:32:36.009796 26991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:36.000855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:36493 (local address 127.29.190.130:40537)
0812 00:32:36.002614 (+ 1759us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:36.002632 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:36.002764 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:36.003284 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:36.003287 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:36.003307 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:36.003808 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:36.003822 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.005261 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.005266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:36.007189 (+ 1923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:36.007200 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.008841 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.008846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:36.009069 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:36.009124 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 00:32:36.009370 (+ 246us) client_negotiation.cc:240] Negotiation successful
0812 00:32:36.009464 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1622,"mutex_wait_us":23,"thread_start_us":939,"threads_started":1}
I20260812 00:32:36.009917 26976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:36.001403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:40537 (local address 127.29.190.131:36493)
0812 00:32:36.001614 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:36.001620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:36.002746 (+ 1126us) server_negotiation.cc:407] Connection header received
0812 00:32:36.002954 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:36.002959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:36.003045 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:36.003105 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:36.004000 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.005108 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.007355 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.008612 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.008761 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:36.008830 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:36.009459 (+ 629us) server_negotiation.cc:299] Negotiation successful
0812 00:32:36.009605 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 00:32:36.010401 26452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91e34f02dab548d8b32f51763c933058" candidate_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c597adf944274a0b851be6a411bc045d" is_pre_election: true
I20260812 00:32:36.010860 26879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91e34f02dab548d8b32f51763c933058" candidate_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" is_pre_election: true
I20260812 00:32:36.011107 26452 raft_consensus.cc:2454] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec46f68ce4e4c41b0c5640bb7cc8b9e in term 0.
I20260812 00:32:36.011459 26879 raft_consensus.cc:2454] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec46f68ce4e4c41b0c5640bb7cc8b9e in term 0.
I20260812 00:32:36.011870 26563 leader_election.cc:302] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec46f68ce4e4c41b0c5640bb7cc8b9e, c597adf944274a0b851be6a411bc045d; no voters:
I20260812 00:32:36.012300 26988 raft_consensus.cc:2781] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:32:36.012452 26988 raft_consensus.cc:482] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:32:36.012578 26988 raft_consensus.cc:3037] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:36.014848 26988 raft_consensus.cc:504] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:36.015666 26988 leader_election.cc:288] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [CANDIDATE]: Term 1 election: Requested vote from peers c597adf944274a0b851be6a411bc045d (127.29.190.129:34699), 0c7ae1c2f59043af98de8a0c27c39a42 (127.29.190.131:36493)
I20260812 00:32:36.016057 26452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91e34f02dab548d8b32f51763c933058" candidate_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c597adf944274a0b851be6a411bc045d"
I20260812 00:32:36.016132 26879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91e34f02dab548d8b32f51763c933058" candidate_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7ae1c2f59043af98de8a0c27c39a42"
I20260812 00:32:36.016297 26452 raft_consensus.cc:3037] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:36.016353 26879 raft_consensus.cc:3037] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:36.018643 26452 raft_consensus.cc:2454] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec46f68ce4e4c41b0c5640bb7cc8b9e in term 1.
I20260812 00:32:36.018661 26879 raft_consensus.cc:2454] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec46f68ce4e4c41b0c5640bb7cc8b9e in term 1.
I20260812 00:32:36.019141 26562 leader_election.cc:302] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0c7ae1c2f59043af98de8a0c27c39a42, 5ec46f68ce4e4c41b0c5640bb7cc8b9e, c597adf944274a0b851be6a411bc045d; no voters:
I20260812 00:32:36.019548 26988 raft_consensus.cc:2781] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:36.020071 26988 raft_consensus.cc:686] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 1 LEADER]: Becoming Leader. State: Replica: 5ec46f68ce4e4c41b0c5640bb7cc8b9e, State: Running, Role: LEADER
I20260812 00:32:36.020673 26988 consensus_queue.cc:237] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } }
I20260812 00:32:36.026129 26211 catalog_manager.cc:5495] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec46f68ce4e4c41b0c5640bb7cc8b9e (127.29.190.130). New cstate: current_term: 1 leader_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec46f68ce4e4c41b0c5640bb7cc8b9e" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 37847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 } health_report { overall_health: UNKNOWN } } }
W20260812 00:32:36.039809 26947 tablet.cc:2369] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:36.073894 26973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:36.067260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.29.190.130:37847)
0812 00:32:36.067552 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:36.067559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:36.067700 (+ 141us) server_negotiation.cc:407] Connection header received
0812 00:32:36.068022 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:36.068026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:36.068129 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:36.068310 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:32:36.068806 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.069632 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.071175 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.071664 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.071825 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:36.072570 (+ 745us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:32:36.073105 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:32:36.073322 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:36.073529 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 00:32:36.073584 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:32:36.082635 26879 raft_consensus.cc:1261] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 1 FOLLOWER]: Refusing update from remote peer 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:36.082639 26452 raft_consensus.cc:1261] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 1 FOLLOWER]: Refusing update from remote peer 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:36.083710 26997 consensus_queue.cc:1035] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7ae1c2f59043af98de8a0c27c39a42" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:36.084059 26988 consensus_queue.cc:1035] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c597adf944274a0b851be6a411bc045d" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:36.112021 26210 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:36.112404 26210 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:36.116861 26210 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aaa196ab49a248d9a452fa726a06df7d: Sending DeleteTablet for 3 replicas of tablet 91e34f02dab548d8b32f51763c933058
I20260812 00:32:36.118234 26636 tablet_service.cc:1514] Processing DeleteTablet for tablet 91e34f02dab548d8b32f51763c933058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:36 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:44044
I20260812 00:32:36.118259 26846 tablet_service.cc:1514] Processing DeleteTablet for tablet 91e34f02dab548d8b32f51763c933058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:36 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:47938
I20260812 00:32:36.118259 26417 tablet_service.cc:1514] Processing DeleteTablet for tablet 91e34f02dab548d8b32f51763c933058 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:36 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:38702
I20260812 00:32:36.119897 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 26322
I20260812 00:32:36.130962 27026 tablet_replica.cc:330] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: stopping tablet replica
I20260812 00:32:36.133044 27026 raft_consensus.cc:2229] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:36.134784 27026 raft_consensus.cc:2258] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:36.139101 27027 tablet_replica.cc:330] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: stopping tablet replica
I20260812 00:32:36.139780 27027 raft_consensus.cc:2229] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:36.140650 27026 ts_tablet_manager.cc:1905] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:36.141309 27027 raft_consensus.cc:2258] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:36.143698 27024 tablet_replica.cc:330] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: stopping tablet replica
I20260812 00:32:36.144274 27024 raft_consensus.cc:2229] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:32:36.145072 27024 raft_consensus.cc:2258] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:36.145807 27027 ts_tablet_manager.cc:1905] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 00:32:36 dist-test-slave-c12x krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:32:36.151889 27024 ts_tablet_manager.cc:1905] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:36.153313 27027 ts_tablet_manager.cc:1918] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:36.153494 27027 log.cc:1196] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/91e34f02dab548d8b32f51763c933058
I20260812 00:32:36.154049 27027 ts_tablet_manager.cc:1939] T 91e34f02dab548d8b32f51763c933058 P c597adf944274a0b851be6a411bc045d: Deleting consensus metadata
I20260812 00:32:36.159495 27024 ts_tablet_manager.cc:1918] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:36.159713 27024 log.cc:1196] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/91e34f02dab548d8b32f51763c933058
I20260812 00:32:36.160297 27024 ts_tablet_manager.cc:1939] T 91e34f02dab548d8b32f51763c933058 P 5ec46f68ce4e4c41b0c5640bb7cc8b9e: Deleting consensus metadata
I20260812 00:32:36.161269 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:36.122650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38706 (local address 127.29.190.129:34699)
0812 00:32:36.122913 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:36.122925 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:36.136686 (+ 13761us) server_negotiation.cc:407] Connection header received
0812 00:32:36.137297 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:36.137306 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:36.137472 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:36.137569 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:36.139842 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.141035 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.145515 (+ 4480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.146164 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.146271 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:36.152565 (+ 6294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:36.152582 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:36.152601 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:36.152657 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:36.157097 (+ 4440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:36.158184 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:36.158195 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:36.158199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:36.158370 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:36.158868 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:36.158874 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:36.158877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:36.159372 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:36.159918 (+ 546us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:36.160605 (+ 687us) server_negotiation.cc:299] Negotiation successful
0812 00:32:36.160851 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 00:32:36.161242 27026 ts_tablet_manager.cc:1918] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:36.161409 27026 log.cc:1196] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/91e34f02dab548d8b32f51763c933058
I20260812 00:32:36.161972 27026 ts_tablet_manager.cc:1939] T 91e34f02dab548d8b32f51763c933058 P 0c7ae1c2f59043af98de8a0c27c39a42: Deleting consensus metadata
I20260812 00:32:36.162489 26183 catalog_manager.cc:4841] TS 5ec46f68ce4e4c41b0c5640bb7cc8b9e (127.29.190.130:37847): tablet 91e34f02dab548d8b32f51763c933058 (table test-table [id=69e0e3cbbe7741cea409eb86c2a80cbb]) successfully deleted
I20260812 00:32:36.163199 26184 catalog_manager.cc:4841] TS c597adf944274a0b851be6a411bc045d (127.29.190.129:34699): tablet 91e34f02dab548d8b32f51763c933058 (table test-table [id=69e0e3cbbe7741cea409eb86c2a80cbb]) successfully deleted
I20260812 00:32:36.163602 26519 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:36.164387 26183 catalog_manager.cc:4841] TS 0c7ae1c2f59043af98de8a0c27c39a42 (127.29.190.131:36493): tablet 91e34f02dab548d8b32f51763c933058 (table test-table [id=69e0e3cbbe7741cea409eb86c2a80cbb]) successfully deleted
I20260812 00:32:36.265210 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 26322
I20260812 00:32:36.294087 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 26538
Aug 12 00:32:36 dist-test-slave-c12x krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:32:36.312455 26973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:36.294984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36180 (local address 127.29.190.130:37847)
0812 00:32:36.295193 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:36.295199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:36.295221 (+ 22us) server_negotiation.cc:407] Connection header received
0812 00:32:36.295496 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:36.295503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:36.295604 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:36.295730 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:36.297119 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.298387 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.299885 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.300578 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.300713 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:36.305183 (+ 4470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:36.305200 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:36.305222 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:36.305269 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:36.309429 (+ 4160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:36.310126 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:36.310135 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:36.310137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:36.310308 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:36.310734 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:36.310740 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:36.310749 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:36.311183 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:36.311545 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:36.311841 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 00:32:36.312079 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:32:36.313293 26734 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:36.428706 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 26538
I20260812 00:32:36.456130 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 26753
Aug 12 00:32:36 dist-test-slave-c12x krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:32:36.471235 26976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:36.456955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37506 (local address 127.29.190.131:36493)
0812 00:32:36.457145 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:36.457149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:36.457168 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:32:36.457330 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:36.457334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:36.457409 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:36.457494 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:36.458806 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.459612 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.460863 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:36.461238 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:36.461328 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:36.465785 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:36.465800 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:36.465817 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:36.465850 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:36.468527 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:36.469158 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:36.469165 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:36.469168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:36.469312 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:36.469653 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:36.469658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:36.469660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:36.470087 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:36.470345 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:36.470675 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 00:32:36.470897 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:32:36.471980 26938 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:36.561426 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 26753
I20260812 00:32:36.583828 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 26154
I20260812 00:32:36.585227 26259 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:36.697960 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 26154
2026-08-12T00:32:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4851 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T00:32:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:36Z Disabled control of system clock
I20260812 00:32:36.799188 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42809
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:40713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:42809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:32:37.161827 27044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:37.162125 27044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:37.162215 27044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:37.169370 27044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:37.169477 27044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:37.169515 27044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:37.169565 27044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:37.169610 27044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:37.178923 27044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:42809
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:37.180276 27044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:37.182176 27044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:37.194661 27057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:37.194753 27051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:37.194728 27052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:37.195525 27044 server_base.cc:1034] running on GCE node
I20260812 00:32:37.196357 27044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:37.197741 27044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:37.198956 27044 hybrid_clock.cc:648] HybridClock initialized: now 1786494757198913 us; error 41 us; skew 500 ppm
I20260812 00:32:37.199277 27044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:37.201777 27044 webserver.cc:460] Webserver started at http://127.29.190.190:36081/ using document root <none> and password file <none>
I20260812 00:32:37.202451 27044 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:37.202543 27044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:37.202817 27044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:37.205739 27044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "33e9b8b8b19d41849c93cbc4df4a4b91"
format_stamp: "Formatted at 2026-08-12 00:32:37 on dist-test-slave-c12x"
server_key: "3129ac7b6c06c1fc31f0656a035837f3"
server_key_iv: "2992bd977e5eb1e667748c888bcfa8a6"
server_key_version: "encryptionkey@0"
I20260812 00:32:37.206516 27044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "33e9b8b8b19d41849c93cbc4df4a4b91"
format_stamp: "Formatted at 2026-08-12 00:32:37 on dist-test-slave-c12x"
server_key: "3129ac7b6c06c1fc31f0656a035837f3"
server_key_iv: "2992bd977e5eb1e667748c888bcfa8a6"
server_key_version: "encryptionkey@0"
I20260812 00:32:37.211661 27044 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 00:32:37.215094 27065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:37.216543 27044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:32:37.216732 27044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "33e9b8b8b19d41849c93cbc4df4a4b91"
format_stamp: "Formatted at 2026-08-12 00:32:37 on dist-test-slave-c12x"
server_key: "3129ac7b6c06c1fc31f0656a035837f3"
server_key_iv: "2992bd977e5eb1e667748c888bcfa8a6"
server_key_version: "encryptionkey@0"
I20260812 00:32:37.216953 27044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:37.237306 27044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:37.238194 27044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:37.238510 27044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:37.258514 27044 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:42809
I20260812 00:32:37.258564 27143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:42809 every 8 connection(s)
I20260812 00:32:37.259922 27044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:37.262866 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 27044
I20260812 00:32:37.263073 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:37.263595 30458 external_mini_cluster.cc:1428] Setting key 1b038651462cebd61bda4f4029721dd9
I20260812 00:32:37.264093 27144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:37.277319 27144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91: Bootstrap starting.
I20260812 00:32:37.277719 27147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:37.265455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41590 (local address 127.29.190.190:42809)
0812 00:32:37.266451 (+ 996us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:37.266462 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:37.266505 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:32:37.268925 (+ 2420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:37.268959 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:37.269448 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:37.269842 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:37.270441 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:37.271810 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:37.273191 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:37.273861 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:37.274094 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:37.275344 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:37.275352 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:37.275365 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:37.275962 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:37.276048 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:37.276070 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:37.276197 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:37.276426 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 00:32:37.276745 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":372,"threads_started":1}
I20260812 00:32:37.281044 27144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:37.282032 27144 log.cc:824] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:37.284955 27144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91: No bootstrap required, opened a new log
I20260812 00:32:37.293018 27144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e9b8b8b19d41849c93cbc4df4a4b91" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42809 } }
I20260812 00:32:37.293457 27144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:37.293572 27144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e9b8b8b19d41849c93cbc4df4a4b91, State: Initialized, Role: FOLLOWER
I20260812 00:32:37.294214 27144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e9b8b8b19d41849c93cbc4df4a4b91" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42809 } }
I20260812 00:32:37.294476 27144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:37.294631 27144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:37.294819 27144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:37.297099 27144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e9b8b8b19d41849c93cbc4df4a4b91" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42809 } }
I20260812 00:32:37.297631 27144 leader_election.cc:302] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33e9b8b8b19d41849c93cbc4df4a4b91; no voters:
I20260812 00:32:37.298214 27144 leader_election.cc:288] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:37.298359 27152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:37.299641 27152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [term 1 LEADER]: Becoming Leader. State: Replica: 33e9b8b8b19d41849c93cbc4df4a4b91, State: Running, Role: LEADER
I20260812 00:32:37.300223 27152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e9b8b8b19d41849c93cbc4df4a4b91" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42809 } }
I20260812 00:32:37.300618 27144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:37.302977 27156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33e9b8b8b19d41849c93cbc4df4a4b91. Latest consensus state: current_term: 1 leader_uuid: "33e9b8b8b19d41849c93cbc4df4a4b91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e9b8b8b19d41849c93cbc4df4a4b91" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42809 } } }
I20260812 00:32:37.303422 27156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:37.303308 27153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33e9b8b8b19d41849c93cbc4df4a4b91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e9b8b8b19d41849c93cbc4df4a4b91" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42809 } } }
I20260812 00:32:37.303637 27153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:37.306159 27171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:37.310472 27171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:37.319288 27171 catalog_manager.cc:1347] Generated new cluster ID: 795fd5ff775743a5811a7722852c2fb5
I20260812 00:32:37.319415 27171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:37.343515 27171 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:37.344995 27171 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:37.355350 27171 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91: Generated new TSK 0
I20260812 00:32:37.356537 27171 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:32:37.370488 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42809
--builtin_ntp_servers=127.29.190.148:40713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:32:37.734050 27192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:37.734341 27192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:37.734504 27192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:37.741995 27192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:37.742101 27192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:37.742288 27192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:32:37.753161 27192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42809
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:37.754563 27192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:37.756412 27192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:37.770265 27201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:37.770313 27203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:37.770344 27199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:37.772362 27192 server_base.cc:1034] running on GCE node
I20260812 00:32:37.773226 27192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:37.774351 27192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:37.775643 27192 hybrid_clock.cc:648] HybridClock initialized: now 1786494757775561 us; error 59 us; skew 500 ppm
I20260812 00:32:37.776026 27192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:37.778744 27192 webserver.cc:460] Webserver started at http://127.29.190.129:35255/ using document root <none> and password file <none>
I20260812 00:32:37.779580 27192 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:37.779723 27192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:37.780079 27192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:37.783073 27192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "71857b2fe1de4a12b406989222122846"
format_stamp: "Formatted at 2026-08-12 00:32:37 on dist-test-slave-c12x"
server_key: "3e9e17bb57fcecbb79ff50554df33046"
server_key_iv: "de503a21c1fca1e438f5604cbb8342a1"
server_key_version: "encryptionkey@0"
I20260812 00:32:37.783955 27192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "71857b2fe1de4a12b406989222122846"
format_stamp: "Formatted at 2026-08-12 00:32:37 on dist-test-slave-c12x"
server_key: "3e9e17bb57fcecbb79ff50554df33046"
server_key_iv: "de503a21c1fca1e438f5604cbb8342a1"
server_key_version: "encryptionkey@0"
I20260812 00:32:37.789484 27192 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:32:37.793270 27210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:37.794646 27192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:32:37.794834 27192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "71857b2fe1de4a12b406989222122846"
format_stamp: "Formatted at 2026-08-12 00:32:37 on dist-test-slave-c12x"
server_key: "3e9e17bb57fcecbb79ff50554df33046"
server_key_iv: "de503a21c1fca1e438f5604cbb8342a1"
server_key_version: "encryptionkey@0"
I20260812 00:32:37.795084 27192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:37.815682 27192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:37.816587 27192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:37.816916 27192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:37.817931 27192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:37.819562 27192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:37.819680 27192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:37.819813 27192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:37.819904 27192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:37.854885 27192 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:35843
I20260812 00:32:37.855053 27376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:35843 every 8 connection(s)
I20260812 00:32:37.856463 27192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:32:37.863170 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 27192
I20260812 00:32:37.863382 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:32:37.863893 30458 external_mini_cluster.cc:1428] Setting key 14b43d917dd6c69153d57a7f67d91a6c
I20260812 00:32:37.866744 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42809
--builtin_ntp_servers=127.29.190.148:40713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:32:37.869889 27381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:37.859340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:37017 (local address 127.29.190.190:42809)
0812 00:32:37.859892 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:37.859897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:37.860982 (+ 1085us) server_negotiation.cc:407] Connection header received
0812 00:32:37.862887 (+ 1905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:37.862893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:37.862988 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:37.863117 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:37.864408 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:37.865312 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:37.866936 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:37.867345 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:37.867522 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:37.868982 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:37.868987 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:37.868991 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:37.869012 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:37.869052 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:37.869065 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:37.869177 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:37.869418 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 00:32:37.869535 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":320,"threads_started":1}
I20260812 00:32:37.870919 27382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:37.859851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42809 (local address 127.29.190.129:37017)
0812 00:32:37.860793 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:37.860840 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:37.862581 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:37.863399 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:37.863412 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:37.863579 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:37.864232 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:37.864251 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:37.865498 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:37.865502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:37.866773 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:37.866786 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:37.867611 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:37.867621 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:37.867870 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:37.868615 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:37.868618 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:37.868662 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:37.868750 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:37.869177 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:37.869191 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:37.869201 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:32:37.869391 (+ 190us) client_negotiation.cc:240] Negotiation successful
0812 00:32:37.869820 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":305,"threads_started":1}
I20260812 00:32:37.872726 27378 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42809
I20260812 00:32:37.873080 27378 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:37.873894 27378 heartbeater.cc:511] Master 127.29.190.190:42809 requested a full tablet report, sending...
I20260812 00:32:37.876147 27086 ts_manager.cc:194] Registered new tserver with Master: 71857b2fe1de4a12b406989222122846 (127.29.190.129:35843)
I20260812 00:32:37.877676 27086 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.129:37017
W20260812 00:32:38.218297 27383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:38.218603 27383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:38.218767 27383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:38.226415 27383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:38.226538 27383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:38.226715 27383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:32:38.236560 27383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42809
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:38.238128 27383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:38.240245 27383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:38.254776 27393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:38.254832 27396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:38.254737 27394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:38.255183 27383 server_base.cc:1034] running on GCE node
I20260812 00:32:38.256222 27383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:38.257326 27383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:38.258627 27383 hybrid_clock.cc:648] HybridClock initialized: now 1786494758258532 us; error 89 us; skew 500 ppm
I20260812 00:32:38.259025 27383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:38.263760 27383 webserver.cc:460] Webserver started at http://127.29.190.130:38423/ using document root <none> and password file <none>
I20260812 00:32:38.264546 27383 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:38.264644 27383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:38.265034 27383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:38.268191 27383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "b185dbc1e34745c4b864ea3ea802496d"
format_stamp: "Formatted at 2026-08-12 00:32:38 on dist-test-slave-c12x"
server_key: "bb894d5690c5c1ee6fd84ef302914c34"
server_key_iv: "2e98d53da198935dbc3f7c0c50fc3f39"
server_key_version: "encryptionkey@0"
I20260812 00:32:38.269044 27383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "b185dbc1e34745c4b864ea3ea802496d"
format_stamp: "Formatted at 2026-08-12 00:32:38 on dist-test-slave-c12x"
server_key: "bb894d5690c5c1ee6fd84ef302914c34"
server_key_iv: "2e98d53da198935dbc3f7c0c50fc3f39"
server_key_version: "encryptionkey@0"
I20260812 00:32:38.274523 27383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 00:32:38.278451 27405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:38.279999 27383 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:32:38.280189 27383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "b185dbc1e34745c4b864ea3ea802496d"
format_stamp: "Formatted at 2026-08-12 00:32:38 on dist-test-slave-c12x"
server_key: "bb894d5690c5c1ee6fd84ef302914c34"
server_key_iv: "2e98d53da198935dbc3f7c0c50fc3f39"
server_key_version: "encryptionkey@0"
I20260812 00:32:38.280444 27383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:38.301801 27383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:38.302790 27383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:38.303141 27383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:38.304333 27383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:38.305948 27383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:38.306090 27383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:38.306221 27383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:38.306310 27383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:38.340639 27383 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:35847
I20260812 00:32:38.340731 27583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:35847 every 8 connection(s)
I20260812 00:32:38.341984 27383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:32:38.349632 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 27383
I20260812 00:32:38.349817 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:32:38.350268 30458 external_mini_cluster.cc:1428] Setting key 91a3677cbaefebc445f264d928bb661e
I20260812 00:32:38.353152 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42809
--builtin_ntp_servers=127.29.190.148:40713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:32:38.354489 27381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.344586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:37039 (local address 127.29.190.190:42809)
0812 00:32:38.344769 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:38.344773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:38.346047 (+ 1274us) server_negotiation.cc:407] Connection header received
0812 00:32:38.347808 (+ 1761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:38.347813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:38.347890 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:38.347983 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:38.348964 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.349756 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.351622 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.352074 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.352216 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.353655 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:38.353662 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:38.353673 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:38.353691 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:38.353723 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:38.353734 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:38.353831 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:38.354063 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 00:32:38.354162 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 00:32:38.355566 27586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.345041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42809 (local address 127.29.190.130:37039)
0812 00:32:38.345903 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:38.345945 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:38.347548 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:38.348181 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:38.348188 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:38.348266 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:38.348807 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.348823 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.349931 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.349942 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.351427 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.351490 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.352307 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.352316 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.352549 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.353312 (+ 763us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:38.353318 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:38.353378 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:38.353462 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:38.353831 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:38.353845 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:38.353855 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:32:38.354050 (+ 195us) client_negotiation.cc:240] Negotiation successful
0812 00:32:38.354436 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":267,"threads_started":1}
I20260812 00:32:38.356967 27584 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42809
I20260812 00:32:38.357268 27584 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:38.358000 27584 heartbeater.cc:511] Master 127.29.190.190:42809 requested a full tablet report, sending...
I20260812 00:32:38.359562 27086 ts_manager.cc:194] Registered new tserver with Master: b185dbc1e34745c4b864ea3ea802496d (127.29.190.130:35847)
I20260812 00:32:38.360759 27086 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.130:37039
W20260812 00:32:38.724080 27588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:38.724359 27588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:38.724447 27588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:38.731660 27588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:38.731767 27588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:38.731871 27588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:32:38.741932 27588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42809
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:38.743368 27588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:38.745539 27588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:38.760519 27596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:38.760535 27594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:38.760597 27599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:38.761276 27588 server_base.cc:1034] running on GCE node
I20260812 00:32:38.761857 27588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:38.762807 27588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:38.764050 27588 hybrid_clock.cc:648] HybridClock initialized: now 1786494758763995 us; error 68 us; skew 500 ppm
I20260812 00:32:38.764415 27588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:38.766849 27588 webserver.cc:460] Webserver started at http://127.29.190.131:43789/ using document root <none> and password file <none>
I20260812 00:32:38.767668 27588 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:38.767947 27588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:38.768409 27588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:38.771652 27588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "8e8856750d9e401e9922ef773d6974d8"
format_stamp: "Formatted at 2026-08-12 00:32:38 on dist-test-slave-c12x"
server_key: "a26d48f073d01ced0de3aedb0636aaf4"
server_key_iv: "a7d718c7e400f3e80af620eef3fd3fdd"
server_key_version: "encryptionkey@0"
I20260812 00:32:38.772560 27588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "8e8856750d9e401e9922ef773d6974d8"
format_stamp: "Formatted at 2026-08-12 00:32:38 on dist-test-slave-c12x"
server_key: "a26d48f073d01ced0de3aedb0636aaf4"
server_key_iv: "a7d718c7e400f3e80af620eef3fd3fdd"
server_key_version: "encryptionkey@0"
I20260812 00:32:38.778268 27588 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 00:32:38.782135 27609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:38.783387 27588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:32:38.783627 27588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "8e8856750d9e401e9922ef773d6974d8"
format_stamp: "Formatted at 2026-08-12 00:32:38 on dist-test-slave-c12x"
server_key: "a26d48f073d01ced0de3aedb0636aaf4"
server_key_iv: "a7d718c7e400f3e80af620eef3fd3fdd"
server_key_version: "encryptionkey@0"
I20260812 00:32:38.783852 27588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:38.809842 27588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:38.810757 27588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:38.811100 27588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:38.812156 27588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:38.813669 27588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:38.813809 27588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:38.813937 27588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:38.814034 27588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:38.849022 27588 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:34009
I20260812 00:32:38.849123 27782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:34009 every 8 connection(s)
I20260812 00:32:38.850353 27588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:32:38.855903 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 27588
I20260812 00:32:38.856089 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:32:38.856681 30458 external_mini_cluster.cc:1428] Setting key 884762da59fa36c727c984f12c1c80de
I20260812 00:32:38.863997 27381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.852994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:35471 (local address 127.29.190.190:42809)
0812 00:32:38.853228 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:38.853235 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:38.854806 (+ 1571us) server_negotiation.cc:407] Connection header received
0812 00:32:38.857200 (+ 2394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:38.857207 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:38.857302 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:38.857422 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:38.858892 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.859987 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.861492 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.861884 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.861976 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.863244 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:38.863249 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:38.863252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:38.863271 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:38.863305 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:38.863316 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:38.863386 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:38.863681 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 00:32:38.863756 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 00:32:38.864957 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.853544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42809 (local address 127.29.190.131:35471)
0812 00:32:38.854628 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:38.854673 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:38.856874 (+ 2201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:38.857831 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:38.857842 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:38.857959 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:38.858697 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.858723 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.860133 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.860138 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.861363 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.861376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.862081 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.862086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.862289 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.862935 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:38.862937 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:38.862977 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:38.863068 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:38.863402 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:38.863410 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:38.863415 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 00:32:38.863652 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 00:32:38.863942 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":341,"threads_started":1}
I20260812 00:32:38.866320 27783 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42809
I20260812 00:32:38.866632 27783 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:38.867353 27783 heartbeater.cc:511] Master 127.29.190.190:42809 requested a full tablet report, sending...
I20260812 00:32:38.868773 27086 ts_manager.cc:194] Registered new tserver with Master: 8e8856750d9e401e9922ef773d6974d8 (127.29.190.131:34009)
I20260812 00:32:38.869522 27086 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.131:35471
I20260812 00:32:38.872141 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:32:38.881115 27378 heartbeater.cc:503] Master 127.29.190.190:42809 was elected leader, sending a full tablet report...
I20260812 00:32:38.882539 27381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.876212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41594 (local address 127.29.190.190:42809)
0812 00:32:38.876455 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:38.876464 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:38.876872 (+ 408us) server_negotiation.cc:407] Connection header received
0812 00:32:38.877092 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:38.877096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:38.877160 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:38.877266 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:38.877775 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.878457 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.879878 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.880296 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.880431 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.881689 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:38.881694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:38.881697 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:38.881715 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:38.881747 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:38.881760 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:38.881932 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:38.882149 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 00:32:38.882204 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:32:38.886718 27086 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41594:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:32:38.894074 27086 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:32:38.917152 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.906732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:35847 (local address 127.0.0.1:34610)
0812 00:32:38.907529 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:38.907571 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:38.907755 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:38.909043 (+ 1288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:38.909050 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:38.909081 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:38.909591 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.909612 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.912090 (+ 2478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.912096 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.914551 (+ 2455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.914566 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.916112 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.916118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.916310 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.916366 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 00:32:38.916504 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 00:32:38.916738 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":1,"thread_start_us":745,"threads_started":1}
I20260812 00:32:38.917960 27805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.906911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34610 (local address 127.29.190.130:35847)
0812 00:32:38.908322 (+ 1411us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:38.908331 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:38.908360 (+ 29us) server_negotiation.cc:407] Connection header received
0812 00:32:38.908459 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:38.908467 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:38.908776 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:38.909014 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:38.909857 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.911898 (+ 2041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.914791 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.915887 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.916101 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.916340 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:38.917445 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0812 00:32:38.917657 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1247,"thread_start_us":1109,"threads_started":1}
I20260812 00:32:38.919485 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.906841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:34009 (local address 127.0.0.1:59704)
0812 00:32:38.908643 (+ 1802us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:38.908661 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:38.908766 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:38.911371 (+ 2605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:38.911376 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:38.911401 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:38.911808 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.911824 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.913813 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.913818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.916110 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.916132 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.918585 (+ 2453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.918592 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.918765 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.918803 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:32:38.918895 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 00:32:38.919030 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1653,"mutex_wait_us":1,"thread_start_us":2464,"threads_started":1}
I20260812 00:32:38.919826 27809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.907319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59704 (local address 127.29.190.131:34009)
0812 00:32:38.910931 (+ 3612us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:38.910938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:38.910964 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:32:38.911038 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:38.911044 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:38.911196 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:38.911383 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:38.912061 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.913670 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.916558 (+ 2888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.918016 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.918226 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.918452 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:38.919127 (+ 675us) server_negotiation.cc:299] Negotiation successful
0812 00:32:38.919307 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3464,"thread_start_us":3322,"threads_started":1}
I20260812 00:32:38.920109 27810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.908739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35843 (local address 127.0.0.1:50452)
0812 00:32:38.910180 (+ 1441us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:38.910203 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:38.910341 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:38.912718 (+ 2377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:38.912723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:38.912747 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:38.913287 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.913301 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.914936 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.914941 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.917079 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:38.917094 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.919334 (+ 2240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.919341 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:38.919600 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.919635 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:32:38.919708 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 00:32:38.919795 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1290,"mutex_wait_us":30,"thread_start_us":1156,"threads_started":1}
I20260812 00:32:38.921399 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:38.909357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50452 (local address 127.29.190.129:35843)
0812 00:32:38.912113 (+ 2756us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:38.912123 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:38.912154 (+ 31us) server_negotiation.cc:407] Connection header received
0812 00:32:38.912259 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:38.912267 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:38.912482 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:38.913494 (+ 1012us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:38.913742 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.914779 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.917599 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:38.919099 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:38.920528 (+ 1429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:38.920750 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:38.920830 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 00:32:38.921016 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2583,"thread_start_us":2449,"threads_started":1}
I20260812 00:32:38.921994 27483 tablet_service.cc:1467] Processing CreateTablet for tablet 29eb6f25479e4f049182b77bc3bd37c6 (DEFAULT_TABLE table=test-table [id=539707804f164f5ba02b00b9bd3c6cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:38.923592 27483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eb6f25479e4f049182b77bc3bd37c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:38.923420 27691 tablet_service.cc:1467] Processing CreateTablet for tablet 29eb6f25479e4f049182b77bc3bd37c6 (DEFAULT_TABLE table=test-table [id=539707804f164f5ba02b00b9bd3c6cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:38.924716 27691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eb6f25479e4f049182b77bc3bd37c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:38.924913 27276 tablet_service.cc:1467] Processing CreateTablet for tablet 29eb6f25479e4f049182b77bc3bd37c6 (DEFAULT_TABLE table=test-table [id=539707804f164f5ba02b00b9bd3c6cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:38.926326 27276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29eb6f25479e4f049182b77bc3bd37c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:38.936681 27814 tablet_bootstrap.cc:492] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Bootstrap starting.
I20260812 00:32:38.939153 27815 tablet_bootstrap.cc:492] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Bootstrap starting.
I20260812 00:32:38.941259 27817 tablet_bootstrap.cc:492] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Bootstrap starting.
I20260812 00:32:38.942700 27814 tablet_bootstrap.cc:654] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:38.942845 27815 tablet_bootstrap.cc:654] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:38.944176 27817 tablet_bootstrap.cc:654] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:38.944133 27815 log.cc:824] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:38.944133 27814 log.cc:824] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:38.945381 27817 log.cc:824] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:38.947793 27814 tablet_bootstrap.cc:492] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: No bootstrap required, opened a new log
I20260812 00:32:38.947798 27815 tablet_bootstrap.cc:492] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: No bootstrap required, opened a new log
I20260812 00:32:38.948098 27815 ts_tablet_manager.cc:1397] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260812 00:32:38.948141 27814 ts_tablet_manager.cc:1397] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260812 00:32:38.948431 27817 tablet_bootstrap.cc:492] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: No bootstrap required, opened a new log
I20260812 00:32:38.948700 27817 ts_tablet_manager.cc:1397] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260812 00:32:38.956013 27815 raft_consensus.cc:348] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:38.956532 27815 raft_consensus.cc:374] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:38.956633 27815 raft_consensus.cc:729] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b185dbc1e34745c4b864ea3ea802496d, State: Initialized, Role: FOLLOWER
I20260812 00:32:38.957298 27815 consensus_queue.cc:260] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:38.958552 27584 heartbeater.cc:503] Master 127.29.190.190:42809 was elected leader, sending a full tablet report...
I20260812 00:32:38.959298 27815 ts_tablet_manager.cc:1428] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260812 00:32:38.959152 27817 raft_consensus.cc:348] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:38.959148 27814 raft_consensus.cc:348] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:38.959630 27817 raft_consensus.cc:374] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:38.959630 27814 raft_consensus.cc:374] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:38.959740 27814 raft_consensus.cc:729] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e8856750d9e401e9922ef773d6974d8, State: Initialized, Role: FOLLOWER
I20260812 00:32:38.959738 27817 raft_consensus.cc:729] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71857b2fe1de4a12b406989222122846, State: Initialized, Role: FOLLOWER
I20260812 00:32:38.960470 27817 consensus_queue.cc:260] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:38.960511 27814 consensus_queue.cc:260] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:38.962071 27783 heartbeater.cc:503] Master 127.29.190.190:42809 was elected leader, sending a full tablet report...
I20260812 00:32:38.962385 27817 ts_tablet_manager.cc:1428] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
I20260812 00:32:38.963405 27814 ts_tablet_manager.cc:1428] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260812 00:32:39.029968 27823 raft_consensus.cc:482] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:39.030452 27823 raft_consensus.cc:504] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:39.032439 27823 leader_election.cc:288] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e8856750d9e401e9922ef773d6974d8 (127.29.190.131:34009), 71857b2fe1de4a12b406989222122846 (127.29.190.129:35843)
I20260812 00:32:39.041848 27809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:39.033063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:56041 (local address 127.29.190.131:34009)
0812 00:32:39.033307 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:39.033316 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:39.034065 (+ 749us) server_negotiation.cc:407] Connection header received
0812 00:32:39.034286 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:39.034292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:39.034411 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:39.034502 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:39.035359 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.036508 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.039553 (+ 3045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.040813 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.040992 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:39.041063 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:39.041484 (+ 421us) server_negotiation.cc:299] Negotiation successful
0812 00:32:39.041606 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:32:39.042017 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:39.032935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:32945 (local address 127.29.190.129:35843)
0812 00:32:39.033169 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:39.033177 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:39.034069 (+ 892us) server_negotiation.cc:407] Connection header received
0812 00:32:39.034286 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:39.034292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:39.034387 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:39.034503 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:39.035360 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.036499 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.039567 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.040836 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.040992 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:39.041063 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:39.041635 (+ 572us) server_negotiation.cc:299] Negotiation successful
0812 00:32:39.041768 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 00:32:39.042292 27827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:39.032860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:34009 (local address 127.29.190.130:56041)
0812 00:32:39.033925 (+ 1065us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:39.033941 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:39.034125 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:39.034540 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:39.034545 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:39.034580 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:39.035142 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:39.035160 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.036648 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.036654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:39.039305 (+ 2651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:39.039315 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.041028 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.041037 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:39.041263 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:39.041306 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 00:32:39.041424 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 00:32:39.041574 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"mutex_wait_us":166,"spinlock_wait_cycles":23936,"thread_start_us":438,"threads_started":1}
I20260812 00:32:39.042856 27828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:39.032760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:35843 (local address 127.29.190.130:32945)
0812 00:32:39.033917 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:39.033940 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:39.034126 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:39.034540 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:39.034545 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:39.034583 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:39.035187 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:39.035202 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.036650 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.036654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:39.039286 (+ 2632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:39.039307 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.041204 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.041210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:39.041425 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:39.041459 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 00:32:39.042214 (+ 755us) client_negotiation.cc:240] Negotiation successful
0812 00:32:39.042352 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"mutex_wait_us":175,"spinlock_wait_cycles":26368,"thread_start_us":842,"threads_started":1}
I20260812 00:32:39.043401 27718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29eb6f25479e4f049182b77bc3bd37c6" candidate_uuid: "b185dbc1e34745c4b864ea3ea802496d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e8856750d9e401e9922ef773d6974d8" is_pre_election: true
I20260812 00:32:39.043907 27310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29eb6f25479e4f049182b77bc3bd37c6" candidate_uuid: "b185dbc1e34745c4b864ea3ea802496d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71857b2fe1de4a12b406989222122846" is_pre_election: true
I20260812 00:32:39.044099 27718 raft_consensus.cc:2454] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b185dbc1e34745c4b864ea3ea802496d in term 0.
I20260812 00:32:39.044488 27310 raft_consensus.cc:2454] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b185dbc1e34745c4b864ea3ea802496d in term 0.
I20260812 00:32:39.044840 27409 leader_election.cc:302] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e8856750d9e401e9922ef773d6974d8, b185dbc1e34745c4b864ea3ea802496d; no voters:
I20260812 00:32:39.045286 27823 raft_consensus.cc:2781] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:32:39.045441 27823 raft_consensus.cc:482] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:32:39.045581 27823 raft_consensus.cc:3037] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:39.047955 27823 raft_consensus.cc:504] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:39.048574 27823 leader_election.cc:288] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [CANDIDATE]: Term 1 election: Requested vote from peers 8e8856750d9e401e9922ef773d6974d8 (127.29.190.131:34009), 71857b2fe1de4a12b406989222122846 (127.29.190.129:35843)
I20260812 00:32:39.049134 27718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29eb6f25479e4f049182b77bc3bd37c6" candidate_uuid: "b185dbc1e34745c4b864ea3ea802496d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e8856750d9e401e9922ef773d6974d8"
I20260812 00:32:39.049130 27310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29eb6f25479e4f049182b77bc3bd37c6" candidate_uuid: "b185dbc1e34745c4b864ea3ea802496d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71857b2fe1de4a12b406989222122846"
I20260812 00:32:39.049345 27718 raft_consensus.cc:3037] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:39.049340 27310 raft_consensus.cc:3037] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:39.051620 27718 raft_consensus.cc:2454] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b185dbc1e34745c4b864ea3ea802496d in term 1.
I20260812 00:32:39.051653 27310 raft_consensus.cc:2454] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b185dbc1e34745c4b864ea3ea802496d in term 1.
I20260812 00:32:39.052093 27409 leader_election.cc:302] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e8856750d9e401e9922ef773d6974d8, b185dbc1e34745c4b864ea3ea802496d; no voters:
I20260812 00:32:39.052402 27823 raft_consensus.cc:2781] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:39.052866 27823 raft_consensus.cc:686] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 1 LEADER]: Becoming Leader. State: Replica: b185dbc1e34745c4b864ea3ea802496d, State: Running, Role: LEADER
I20260812 00:32:39.053385 27823 consensus_queue.cc:237] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } }
I20260812 00:32:39.058000 27085 catalog_manager.cc:5495] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d reported cstate change: term changed from 0 to 1, leader changed from <none> to b185dbc1e34745c4b864ea3ea802496d (127.29.190.130). New cstate: current_term: 1 leader_uuid: "b185dbc1e34745c4b864ea3ea802496d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b185dbc1e34745c4b864ea3ea802496d" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 35847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 } health_report { overall_health: UNKNOWN } } }
I20260812 00:32:39.084880 27805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:39.079206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34620 (local address 127.29.190.130:35847)
0812 00:32:39.079494 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:39.079499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:39.079515 (+ 16us) server_negotiation.cc:407] Connection header received
0812 00:32:39.079609 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:39.079612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:39.079698 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:39.079865 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:32:39.080286 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.080972 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.082393 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.082808 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.082954 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:39.083616 (+ 662us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:32:39.084207 (+ 591us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:32:39.084397 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:39.084549 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 00:32:39.084595 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:32:39.094080 27310 raft_consensus.cc:1261] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 1 FOLLOWER]: Refusing update from remote peer b185dbc1e34745c4b864ea3ea802496d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260812 00:32:39.094113 27585 tablet.cc:2369] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:39.094208 27718 raft_consensus.cc:1261] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 1 FOLLOWER]: Refusing update from remote peer b185dbc1e34745c4b864ea3ea802496d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:39.095181 27829 consensus_queue.cc:1035] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71857b2fe1de4a12b406989222122846" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 35843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:39.095593 27823 consensus_queue.cc:1035] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e8856750d9e401e9922ef773d6974d8" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 00:32:39.102130 27785 tablet.cc:2369] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:39.107390 27833 mvcc.cc:205] Tried to move back new op lower bound from 7317482533238280192 to 7317482533086801920. Current Snapshot: MvccSnapshot[applied={T|T < 7317482533238280192}]
W20260812 00:32:39.108942 27379 tablet.cc:2369] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:39.110134 27834 mvcc.cc:205] Tried to move back new op lower bound from 7317482533238280192 to 7317482533086801920. Current Snapshot: MvccSnapshot[applied={T|T < 7317482533238280192}]
I20260812 00:32:39.121407 27083 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:39.121747 27083 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:39.125460 27083 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33e9b8b8b19d41849c93cbc4df4a4b91: Sending DeleteTablet for 3 replicas of tablet 29eb6f25479e4f049182b77bc3bd37c6
I20260812 00:32:39.126631 27691 tablet_service.cc:1514] Processing DeleteTablet for tablet 29eb6f25479e4f049182b77bc3bd37c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:39 UTC) from {username='slave'} at 127.0.0.1:59704
I20260812 00:32:39.126724 27483 tablet_service.cc:1514] Processing DeleteTablet for tablet 29eb6f25479e4f049182b77bc3bd37c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:39 UTC) from {username='slave'} at 127.0.0.1:34610
I20260812 00:32:39.127696 27276 tablet_service.cc:1514] Processing DeleteTablet for tablet 29eb6f25479e4f049182b77bc3bd37c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:39 UTC) from {username='slave'} at 127.0.0.1:50452
I20260812 00:32:39.128698 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 27192
I20260812 00:32:39.128705 27846 tablet_replica.cc:330] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: stopping tablet replica
I20260812 00:32:39.129397 27846 raft_consensus.cc:2229] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:39.130136 27846 raft_consensus.cc:2258] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:39.133460 27846 ts_tablet_manager.cc:1905] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:39.139005 27842 tablet_replica.cc:330] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: stopping tablet replica
I20260812 00:32:39.139525 27842 raft_consensus.cc:2229] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:39.140058 27842 raft_consensus.cc:2258] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:39.143031 27846 ts_tablet_manager.cc:1918] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:39.143352 27846 log.cc:1196] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/29eb6f25479e4f049182b77bc3bd37c6
I20260812 00:32:39.144196 27846 ts_tablet_manager.cc:1939] T 29eb6f25479e4f049182b77bc3bd37c6 P 71857b2fe1de4a12b406989222122846: Deleting consensus metadata
I20260812 00:32:39.146405 27070 catalog_manager.cc:4841] TS 71857b2fe1de4a12b406989222122846 (127.29.190.129:35843): tablet 29eb6f25479e4f049182b77bc3bd37c6 (table test-table [id=539707804f164f5ba02b00b9bd3c6cfe]) successfully deleted
I20260812 00:32:39.147513 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:39.132376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50462 (local address 127.29.190.129:35843)
0812 00:32:39.132557 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:39.132563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:39.132582 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:32:39.132647 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:39.132652 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:39.132755 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:39.132862 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:39.140008 (+ 7146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.141237 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.143287 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.144015 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.144120 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:39.145708 (+ 1588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:39.145723 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:39.145742 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:39.146556 (+ 814us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:39.146619 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:39.146644 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:39.146733 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:39.146968 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 00:32:39.147094 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 00:32:39.147640 27845 tablet_replica.cc:330] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: stopping tablet replica
I20260812 00:32:39.148119 27845 raft_consensus.cc:2229] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:32:39.148236 27372 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:39.148900 27845 raft_consensus.cc:2258] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:39.149997 27842 ts_tablet_manager.cc:1905] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:39.153576 27845 ts_tablet_manager.cc:1905] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:39.157658 27842 ts_tablet_manager.cc:1918] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:39.157835 27842 log.cc:1196] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/29eb6f25479e4f049182b77bc3bd37c6
I20260812 00:32:39.158376 27842 ts_tablet_manager.cc:1939] T 29eb6f25479e4f049182b77bc3bd37c6 P 8e8856750d9e401e9922ef773d6974d8: Deleting consensus metadata
I20260812 00:32:39.160338 27069 catalog_manager.cc:4841] TS 8e8856750d9e401e9922ef773d6974d8 (127.29.190.131:34009): tablet 29eb6f25479e4f049182b77bc3bd37c6 (table test-table [id=539707804f164f5ba02b00b9bd3c6cfe]) successfully deleted
I20260812 00:32:39.161335 27845 ts_tablet_manager.cc:1918] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:39.161501 27845 log.cc:1196] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/29eb6f25479e4f049182b77bc3bd37c6
I20260812 00:32:39.162093 27845 ts_tablet_manager.cc:1939] T 29eb6f25479e4f049182b77bc3bd37c6 P b185dbc1e34745c4b864ea3ea802496d: Deleting consensus metadata
I20260812 00:32:39.163877 27070 catalog_manager.cc:4841] TS b185dbc1e34745c4b864ea3ea802496d (127.29.190.130:35847): tablet 29eb6f25479e4f049182b77bc3bd37c6 (table test-table [id=539707804f164f5ba02b00b9bd3c6cfe]) successfully deleted
I20260812 00:32:39.243579 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 27192
I20260812 00:32:39.269739 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 27383
I20260812 00:32:39.279299 27805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:39.270800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34628 (local address 127.29.190.130:35847)
0812 00:32:39.270995 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:39.271003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:39.271024 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:32:39.271093 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:39.271099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:39.271198 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:39.271324 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:39.271856 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.273035 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.274935 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.275854 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.275988 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:39.277303 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:39.277316 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:39.277337 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:39.278213 (+ 876us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:39.278277 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:39.278304 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:39.278427 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:39.278592 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 00:32:39.278704 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:32:39.280131 27576 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:39.394228 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 27383
I20260812 00:32:39.421591 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 27588
I20260812 00:32:39.428819 27809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:39.422517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59714 (local address 127.29.190.131:34009)
0812 00:32:39.422729 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:39.422735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:39.422756 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:32:39.422958 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:39.422968 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:39.423055 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:39.423169 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:39.423636 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.424379 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.425684 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:39.426075 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:39.426216 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:39.427341 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:39.427350 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:39.427366 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:39.428064 (+ 698us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:39.428112 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:39.428134 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:39.428260 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:39.428392 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 00:32:39.428506 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:32:39.429488 27777 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:39.519951 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 27588
I20260812 00:32:39.543936 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 27044
I20260812 00:32:39.545051 27137 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:39.656865 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 27044
2026-08-12T00:32:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2955 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:39 dist-test-slave-c12x krb5kdc[27860](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:39 dist-test-slave-c12x krb5kdc[27860](info): set up 2 sockets
Aug 12 00:32:39 dist-test-slave-c12x krb5kdc[27860](info): commencing operation
krb5kdc: starting...
W20260812 00:32:41.015208 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:32:41 dist-test-slave-c12x krb5kdc[27860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:32:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:32:41.335521 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:43295
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:43295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:41.703280 27880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:41.703745 27880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:41.703929 27880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:41.711632 27880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:41.711783 27880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:41.711898 27880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:41.712018 27880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:41.712112 27880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:41.722532 27880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:43295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:43295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:41.724095 27880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:41.725565 27880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:41.738747 27887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:41.738937 27891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:41.738863 27888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:41.740226 27880 server_base.cc:1034] running on GCE node
I20260812 00:32:41.741106 27880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:41.742633 27880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:41.743841 27880 hybrid_clock.cc:648] HybridClock initialized: now 1786494761743791 us; error 40 us; skew 500 ppm
I20260812 00:32:41.744234 27880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:41 dist-test-slave-c12x krb5kdc[27860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494761, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:41.747596 27880 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:32:41.749239 27880 webserver.cc:460] Webserver started at http://127.29.190.190:39221/ using document root <none> and password file <none>
I20260812 00:32:41.749919 27880 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:41.750025 27880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:41.750299 27880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:41.753412 27880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "7c2757d4ef234dae972d71506a37a9c0"
format_stamp: "Formatted at 2026-08-12 00:32:41 on dist-test-slave-c12x"
server_key: "e3d0972d2e5a0fdfa0533a2678bad7ab"
server_key_iv: "791d9459b7266c38085973dbbc0911c0"
server_key_version: "encryptionkey@0"
I20260812 00:32:41.754122 27880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "7c2757d4ef234dae972d71506a37a9c0"
format_stamp: "Formatted at 2026-08-12 00:32:41 on dist-test-slave-c12x"
server_key: "e3d0972d2e5a0fdfa0533a2678bad7ab"
server_key_iv: "791d9459b7266c38085973dbbc0911c0"
server_key_version: "encryptionkey@0"
I20260812 00:32:41.759369 27880 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 00:32:41.762913 27902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:41.764559 27880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 00:32:41.764755 27880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "7c2757d4ef234dae972d71506a37a9c0"
format_stamp: "Formatted at 2026-08-12 00:32:41 on dist-test-slave-c12x"
server_key: "e3d0972d2e5a0fdfa0533a2678bad7ab"
server_key_iv: "791d9459b7266c38085973dbbc0911c0"
server_key_version: "encryptionkey@0"
I20260812 00:32:41.765044 27880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:41.801800 27880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:41.806486 27880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:41.806761 27880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:41.826745 27880 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:43295
I20260812 00:32:41.826766 27971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:43295 every 8 connection(s)
I20260812 00:32:41.828284 27880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:41.832274 27972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:41.836874 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 27880
I20260812 00:32:41.837085 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:41.837703 30458 external_mini_cluster.cc:1428] Setting key c9fabd07047025f58a79100c5290fd81
I20260812 00:32:41.844509 27972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0: Bootstrap starting.
I20260812 00:32:41.848331 27972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:41.849606 27972 log.cc:824] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:41.852532 27972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0: No bootstrap required, opened a new log
Aug 12 00:32:41 dist-test-slave-c12x krb5kdc[27860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:41.860873 27972 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2757d4ef234dae972d71506a37a9c0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43295 } }
I20260812 00:32:41.861392 27972 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:41.861531 27972 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2757d4ef234dae972d71506a37a9c0, State: Initialized, Role: FOLLOWER
I20260812 00:32:41.862186 27972 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2757d4ef234dae972d71506a37a9c0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43295 } }
I20260812 00:32:41.862462 27972 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:41.862490 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:41.839858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44400 (local address 127.29.190.190:43295)
0812 00:32:41.840726 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:41.840738 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:41.840782 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:32:41.843025 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:41.843051 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:41.843506 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:41.843842 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:41.845737 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:41.847099 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:41.849098 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:41.849876 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:41.850027 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:41.854408 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:41.854417 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:41.854432 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:41.854479 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:41.857889 (+ 3410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:41.858703 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:41.858711 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:41.858718 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:41.858897 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:41.859327 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:41.859331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:41.859333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:41.859988 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:41.860330 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:41.860795 (+ 465us) server_negotiation.cc:299] Negotiation successful
0812 00:32:41.861238 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":412,"threads_started":1}
I20260812 00:32:41.862653 27972 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:41.862897 27972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:41.865801 27972 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2757d4ef234dae972d71506a37a9c0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43295 } }
I20260812 00:32:41.866283 27972 leader_election.cc:302] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c2757d4ef234dae972d71506a37a9c0; no voters:
I20260812 00:32:41.866876 27972 leader_election.cc:288] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:41.867031 27978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:41.867787 27978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2757d4ef234dae972d71506a37a9c0, State: Running, Role: LEADER
I20260812 00:32:41.868405 27978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2757d4ef234dae972d71506a37a9c0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43295 } }
I20260812 00:32:41.869252 27972 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:41.871620 27979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c2757d4ef234dae972d71506a37a9c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2757d4ef234dae972d71506a37a9c0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43295 } } }
I20260812 00:32:41.871657 27980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c2757d4ef234dae972d71506a37a9c0. Latest consensus state: current_term: 1 leader_uuid: "7c2757d4ef234dae972d71506a37a9c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2757d4ef234dae972d71506a37a9c0" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 43295 } } }
I20260812 00:32:41.872191 27979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:41.872191 27980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0 [sys.catalog]: This master's current role is: LEADER
W20260812 00:32:41.880681 28002 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:32:41.880888 28002 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:32:41.881063 27991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:41.883147 27991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:41.892756 27991 catalog_manager.cc:1347] Generated new cluster ID: 35ca5283864c46799599fda907fadfc3
I20260812 00:32:41.892901 27991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:41.904852 27991 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:41.906301 27991 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:41.922047 27991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0: Generated new TSK 0
I20260812 00:32:41.923226 27991 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.190.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
Entry for principal kudu/127.29.190.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab.
I20260812 00:32:42.006879 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:43295
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:42.365592 28010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:42.365927 28010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:42.366103 28010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:42.374419 28010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:42.374557 28010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:42.374752 28010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:32:42.384799 28010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.129.keytab
--principal=kudu/127.29.190.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:43295
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:42.386184 28010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:42.387646 28010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:42.401283 28015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:42.401269 28024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:42.401306 28019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:42.402186 28010 server_base.cc:1034] running on GCE node
I20260812 00:32:42.402813 28010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:42.403882 28010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:42.405117 28010 hybrid_clock.cc:648] HybridClock initialized: now 1786494762405054 us; error 60 us; skew 500 ppm
I20260812 00:32:42.405434 28010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:42 dist-test-slave-c12x krb5kdc[27860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494762, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:42.408635 28010 init.cc:377] Logged in from keytab as kudu/127.29.190.129@KRBTEST.COM (short username kudu)
I20260812 00:32:42.410199 28010 webserver.cc:460] Webserver started at http://127.29.190.129:34885/ using document root <none> and password file <none>
I20260812 00:32:42.410913 28010 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:42.411072 28010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:42.411406 28010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:42.414454 28010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "76b7666208824a6890cc54755829c244"
format_stamp: "Formatted at 2026-08-12 00:32:42 on dist-test-slave-c12x"
server_key: "6053d93971eaa7067545e53994bf9caf"
server_key_iv: "58b7f72c62f2597ef6d6e1549011eae1"
server_key_version: "encryptionkey@0"
I20260812 00:32:42.415248 28010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "76b7666208824a6890cc54755829c244"
format_stamp: "Formatted at 2026-08-12 00:32:42 on dist-test-slave-c12x"
server_key: "6053d93971eaa7067545e53994bf9caf"
server_key_iv: "58b7f72c62f2597ef6d6e1549011eae1"
server_key_version: "encryptionkey@0"
I20260812 00:32:42.420440 28010 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 00:32:42.423933 28033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:42.425324 28010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 00:32:42.425513 28010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "76b7666208824a6890cc54755829c244"
format_stamp: "Formatted at 2026-08-12 00:32:42 on dist-test-slave-c12x"
server_key: "6053d93971eaa7067545e53994bf9caf"
server_key_iv: "58b7f72c62f2597ef6d6e1549011eae1"
server_key_version: "encryptionkey@0"
I20260812 00:32:42.425725 28010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:42.444335 28010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:42.448388 28010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:42.448704 28010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:42.449728 28010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:42.451125 28010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:42.451236 28010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:42.451407 28010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:42.451519 28010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 00:32:42.487167 28010 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:46615
I20260812 00:32:42.487218 28205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:46615 every 8 connection(s)
I20260812 00:32:42.488547 28010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:32:42.489576 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 28010
I20260812 00:32:42.489763 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:32:42.490348 30458 external_mini_cluster.cc:1428] Setting key 4a79f3135bc08d2c5f6fcf13be95b685
Aug 12 00:32:42 dist-test-slave-c12x krb5kdc[27860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494762, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.129@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:42.513934 28210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:42.491505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:57563 (local address 127.29.190.190:43295)
0812 00:32:42.492068 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:42.492073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:42.493314 (+ 1241us) server_negotiation.cc:407] Connection header received
0812 00:32:42.496347 (+ 3033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:42.496352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:42.496426 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:42.496528 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:42.498682 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:42.499519 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:42.502098 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:42.502527 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:42.502633 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:42.507363 (+ 4730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:42.507369 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:42.507373 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:42.507409 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:42.510302 (+ 2893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:42.511330 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:42.511339 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:42.511342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:42.511563 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:42.512071 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:42.512074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:42.512076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:42.512349 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:42.512485 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:42.513480 (+ 995us) server_negotiation.cc:299] Negotiation successful
0812 00:32:42.513668 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":334,"threads_started":1}
I20260812 00:32:42.515622 28216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:42.492125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:43295 (local address 127.29.190.129:57563)
0812 00:32:42.493121 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:42.493186 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:42.496025 (+ 2839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:42.496815 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:42.496829 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:42.497649 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:42.498486 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:42.498516 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:42.499689 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:42.499698 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:42.501903 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:42.501922 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:42.502789 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:42.502799 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:42.503142 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:42.503936 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:42.503992 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:42.507077 (+ 3085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:42.510460 (+ 3383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:42.510473 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:42.510492 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:42.511193 (+ 701us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:42.511681 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:42.511689 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:42.511695 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:42.511951 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:42.512493 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:42.512503 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:42.513050 (+ 547us) client_negotiation.cc:769] Sending connection context
0812 00:32:42.513386 (+ 336us) client_negotiation.cc:240] Negotiation successful
0812 00:32:42.514015 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":403,"threads_started":1}
I20260812 00:32:42.517326 28206 heartbeater.cc:347] Connected to a master server at 127.29.190.190:43295
I20260812 00:32:42.517653 28206 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:42.518433 28206 heartbeater.cc:511] Master 127.29.190.190:43295 requested a full tablet report, sending...
I20260812 00:32:42.520686 27928 ts_manager.cc:194] Registered new tserver with Master: 76b7666208824a6890cc54755829c244 (127.29.190.129:46615)
I20260812 00:32:42.522256 27928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.129@KRBTEST.COM'} at 127.29.190.129:57563
WARNING: no policy specified for kudu/127.29.190.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
Entry for principal kudu/127.29.190.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab.
I20260812 00:32:42.562487 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:43295
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:42.913722 28220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:42.914072 28220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:42.914250 28220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:42.921761 28220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:42.921936 28220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:42.922134 28220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:32:42.932843 28220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.130.keytab
--principal=kudu/127.29.190.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:43295
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:42.934204 28220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:42.935662 28220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:42.949517 28227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:42.949608 28229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:42.949563 28231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:42.950871 28220 server_base.cc:1034] running on GCE node
I20260812 00:32:42.951630 28220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:42.952677 28220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:42.953895 28220 hybrid_clock.cc:648] HybridClock initialized: now 1786494762953843 us; error 41 us; skew 500 ppm
I20260812 00:32:42.954253 28220 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:42 dist-test-slave-c12x krb5kdc[27860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494762, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:42.957527 28220 init.cc:377] Logged in from keytab as kudu/127.29.190.130@KRBTEST.COM (short username kudu)
I20260812 00:32:42.959069 28220 webserver.cc:460] Webserver started at http://127.29.190.130:41265/ using document root <none> and password file <none>
I20260812 00:32:42.959887 28220 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:42.960044 28220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:42.960376 28220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:42.963510 28220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "3b53081167e64180b47a9e5f7f3a5918"
format_stamp: "Formatted at 2026-08-12 00:32:42 on dist-test-slave-c12x"
server_key: "27e9d3fb4ece8813c037392da8871605"
server_key_iv: "2b8e5193246dec1143997d3bf77d6e5d"
server_key_version: "encryptionkey@0"
I20260812 00:32:42.964322 28220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "3b53081167e64180b47a9e5f7f3a5918"
format_stamp: "Formatted at 2026-08-12 00:32:42 on dist-test-slave-c12x"
server_key: "27e9d3fb4ece8813c037392da8871605"
server_key_iv: "2b8e5193246dec1143997d3bf77d6e5d"
server_key_version: "encryptionkey@0"
I20260812 00:32:42.969519 28220 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 00:32:42.973165 28240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:42.974604 28220 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:32:42.974735 28220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "3b53081167e64180b47a9e5f7f3a5918"
format_stamp: "Formatted at 2026-08-12 00:32:42 on dist-test-slave-c12x"
server_key: "27e9d3fb4ece8813c037392da8871605"
server_key_iv: "2b8e5193246dec1143997d3bf77d6e5d"
server_key_version: "encryptionkey@0"
I20260812 00:32:42.974895 28220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:43.005009 28220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:43.009157 28220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:43.009411 28220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:43.010424 28220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:43.011816 28220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:43.011889 28220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:43.011981 28220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:43.012042 28220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:43.046150 28220 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:33331
I20260812 00:32:43.046203 28401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:33331 every 8 connection(s)
I20260812 00:32:43.047605 28220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:32:43.054817 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 28220
I20260812 00:32:43.055044 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:32:43.055550 30458 external_mini_cluster.cc:1428] Setting key 0dc3f9d164e4a239ea1d130782ad3c2f
Aug 12 00:32:43 dist-test-slave-c12x krb5kdc[27860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494762, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.130@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:43.068315 28406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.050259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:58657 (local address 127.29.190.190:43295)
0812 00:32:43.050705 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.050710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.051781 (+ 1071us) server_negotiation.cc:407] Connection header received
0812 00:32:43.053659 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.053666 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.053755 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.053893 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:43.055503 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.056484 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.058068 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.058496 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.058638 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.062431 (+ 3793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:43.062439 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:43.062445 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:43.062483 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:43.065169 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:43.065941 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:43.065948 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:43.065951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:43.066077 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:43.066510 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:43.066524 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:43.066527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:43.066804 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:43.066964 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.067721 (+ 757us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.067946 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":202,"threads_started":1}
I20260812 00:32:43.069401 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.050861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:43295 (local address 127.29.190.130:58657)
0812 00:32:43.051616 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.051665 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.053380 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.054140 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.054148 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.054651 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:43.055310 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.055330 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.056657 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.056663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.057899 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.057911 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.058733 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.058740 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.058977 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.059732 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:43.059754 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:43.062198 (+ 2444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:43.065330 (+ 3132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:43.065339 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:43.065357 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:43.065807 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:43.066192 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:43.066196 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:43.066200 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:43.066393 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:43.066938 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:43.066946 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:43.067309 (+ 363us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.067632 (+ 323us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.068181 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":286,"threads_started":1}
I20260812 00:32:43.070910 28403 heartbeater.cc:347] Connected to a master server at 127.29.190.190:43295
I20260812 00:32:43.071245 28403 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:43.072161 28403 heartbeater.cc:511] Master 127.29.190.190:43295 requested a full tablet report, sending...
I20260812 00:32:43.073908 27928 ts_manager.cc:194] Registered new tserver with Master: 3b53081167e64180b47a9e5f7f3a5918 (127.29.190.130:33331)
I20260812 00:32:43.075248 27928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.130@KRBTEST.COM'} at 127.29.190.130:58657
WARNING: no policy specified for kudu/127.29.190.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
Entry for principal kudu/127.29.190.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab.
I20260812 00:32:43.126200 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:43295
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:43.471076 28411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:43.471359 28411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:43.471524 28411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:43.478886 28411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:43.478997 28411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:43.479158 28411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:32:43.489094 28411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.131.keytab
--principal=kudu/127.29.190.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:43295
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:43.490391 28411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:43.491827 28411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:43.505705 28420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:43.505683 28418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:43.506114 28417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:43.506337 28411 server_base.cc:1034] running on GCE node
I20260812 00:32:43.507040 28411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:43.508042 28411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:43.509269 28411 hybrid_clock.cc:648] HybridClock initialized: now 1786494763509231 us; error 53 us; skew 500 ppm
I20260812 00:32:43.509608 28411 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:43 dist-test-slave-c12x krb5kdc[27860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494763, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:43.512936 28411 init.cc:377] Logged in from keytab as kudu/127.29.190.131@KRBTEST.COM (short username kudu)
I20260812 00:32:43.514343 28411 webserver.cc:460] Webserver started at http://127.29.190.131:45619/ using document root <none> and password file <none>
I20260812 00:32:43.515012 28411 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:43.515118 28411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:43.515372 28411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:43.518293 28411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "23e345151de147448b9fed30691f985c"
format_stamp: "Formatted at 2026-08-12 00:32:43 on dist-test-slave-c12x"
server_key: "75060d9272bdebae56571758b8bc3919"
server_key_iv: "b8935011e00de78006d8b427364c4ace"
server_key_version: "encryptionkey@0"
I20260812 00:32:43.519012 28411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "23e345151de147448b9fed30691f985c"
format_stamp: "Formatted at 2026-08-12 00:32:43 on dist-test-slave-c12x"
server_key: "75060d9272bdebae56571758b8bc3919"
server_key_iv: "b8935011e00de78006d8b427364c4ace"
server_key_version: "encryptionkey@0"
I20260812 00:32:43.524089 28411 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260812 00:32:43.525220 28206 heartbeater.cc:503] Master 127.29.190.190:43295 was elected leader, sending a full tablet report...
I20260812 00:32:43.527743 28429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:43.529098 28411 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:32:43.529285 28411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "23e345151de147448b9fed30691f985c"
format_stamp: "Formatted at 2026-08-12 00:32:43 on dist-test-slave-c12x"
server_key: "75060d9272bdebae56571758b8bc3919"
server_key_iv: "b8935011e00de78006d8b427364c4ace"
server_key_version: "encryptionkey@0"
I20260812 00:32:43.529491 28411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:43.545092 28411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:43.549686 28411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:43.549988 28411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:43.550994 28411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:43.552443 28411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:43.552520 28411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:43.552680 28411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:43.552733 28411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:43.589744 28411 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:45793
I20260812 00:32:43.589775 28598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:45793 every 8 connection(s)
I20260812 00:32:43.591084 28411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:32:43.597062 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 28411
I20260812 00:32:43.597270 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:32:43.597842 30458 external_mini_cluster.cc:1428] Setting key 5f2c27b85897c1847c7d3d7292961333
Aug 12 00:32:43 dist-test-slave-c12x krb5kdc[27860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494763, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.131@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:32:43.611019 28603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.593779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:53745 (local address 127.29.190.190:43295)
0812 00:32:43.594258 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.594262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.595237 (+ 975us) server_negotiation.cc:407] Connection header received
0812 00:32:43.597283 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.597288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.597419 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.597542 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:43.599419 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.600525 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.602131 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.602511 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.602613 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.605949 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:43.605955 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:43.605958 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:43.605989 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:43.608414 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:43.609065 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:43.609069 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:43.609071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:43.609201 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:43.609569 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:43.609572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:43.609574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:43.609814 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:43.609929 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.610547 (+ 618us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.610709 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":235,"threads_started":1}
I20260812 00:32:43.611995 28604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.594339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:43295 (local address 127.29.190.131:53745)
0812 00:32:43.595063 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.595103 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.596941 (+ 1838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.597825 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.597839 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.598503 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:43.599235 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.599263 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.600695 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.600705 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.601986 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.601999 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.602727 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.602732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.602936 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.603659 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:32:43.603681 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:43.605765 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:43.608530 (+ 2765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:43.608537 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:43.608548 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:43.608935 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:43.609295 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:32:43.609298 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:32:43.609300 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:32:43.609476 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:32:43.609915 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:43.609920 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:43.610211 (+ 291us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.610431 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.610775 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":282,"threads_started":1}
I20260812 00:32:43.613587 28599 heartbeater.cc:347] Connected to a master server at 127.29.190.190:43295
I20260812 00:32:43.613905 28599 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:43.614605 28599 heartbeater.cc:511] Master 127.29.190.190:43295 requested a full tablet report, sending...
I20260812 00:32:43.616402 27927 ts_manager.cc:194] Registered new tserver with Master: 23e345151de147448b9fed30691f985c (127.29.190.131:45793)
I20260812 00:32:43.617821 27927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.190.131@KRBTEST.COM'} at 127.29.190.131:53745
I20260812 00:32:43.625958 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:32:43.642666 28603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.630192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44402 (local address 127.29.190.190:43295)
0812 00:32:43.630411 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.630422 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.630925 (+ 503us) server_negotiation.cc:407] Connection header received
0812 00:32:43.631066 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.631070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.631132 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.631214 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:43.632851 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.633572 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.634945 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.635369 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.635531 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.637752 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:43.637757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:43.637760 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:43.637792 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:43.640433 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:43.641060 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:43.641064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:43.641067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:43.641192 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:43.641508 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:43.641511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:43.641513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:43.641800 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:43.641975 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.642270 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.642433 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 00:32:43.646579 27927 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:32:43.653554 27927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:32:43.686930 28616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.665918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:45793 (local address 127.0.0.1:43890)
0812 00:32:43.677099 (+ 11181us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.677141 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.677344 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.678174 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.678183 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.678224 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:43.678755 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.678771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.681050 (+ 2279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.681055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.683563 (+ 2508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.683583 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.685798 (+ 2215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.685806 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.686023 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.686085 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.686232 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.686451 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10909,"mutex_wait_us":25,"thread_start_us":10795,"threads_started":1}
I20260812 00:32:43.687186 28623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.667188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57524 (local address 127.29.190.130:33331)
0812 00:32:43.675541 (+ 8353us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.675558 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.679613 (+ 4055us) server_negotiation.cc:407] Connection header received
0812 00:32:43.679934 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.679942 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.680148 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.680323 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:43.680976 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.682496 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.684670 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.686043 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.686231 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.686399 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.686641 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.686807 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8087,"thread_start_us":7939,"threads_started":1}
I20260812 00:32:43.687776 28622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.666052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:46615 (local address 127.0.0.1:48178)
0812 00:32:43.677941 (+ 11889us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.677962 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.678103 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.679480 (+ 1377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.679485 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.679549 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:43.680044 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.680054 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.682310 (+ 2256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.682316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.684619 (+ 2303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.684637 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.686874 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.686880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.687076 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.687123 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.687206 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.687332 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11758,"mutex_wait_us":93,"thread_start_us":13152,"threads_started":1}
I20260812 00:32:43.687243 28617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.666545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:33331 (local address 127.0.0.1:57524)
0812 00:32:43.679494 (+ 12949us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.679512 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.679723 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.680344 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.680350 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.680379 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:43.680804 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.680817 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.682652 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.682658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.684498 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.684513 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.686261 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.686267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.686440 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.686475 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.686589 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.686714 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12781,"thread_start_us":11116,"threads_started":1}
I20260812 00:32:43.688473 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.666295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43890 (local address 127.29.190.131:45793)
0812 00:32:43.676677 (+ 10382us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.676688 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.677498 (+ 810us) server_negotiation.cc:407] Connection header received
0812 00:32:43.677643 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.677653 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.677926 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.679000 (+ 1074us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:43.679302 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.680886 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.683745 (+ 2859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.685263 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.685452 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.685643 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.688062 (+ 2419us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.688223 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10186,"thread_start_us":10011,"threads_started":1}
I20260812 00:32:43.688711 28619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.666576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48178 (local address 127.29.190.129:46615)
0812 00:32:43.678790 (+ 12214us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.678801 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.678831 (+ 30us) server_negotiation.cc:407] Connection header received
0812 00:32:43.678928 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.678936 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.679184 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.679375 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:43.680249 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.682166 (+ 1917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.684843 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.686319 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.686528 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.686692 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.687567 (+ 875us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.687710 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12014,"thread_start_us":11841,"threads_started":1}
I20260812 00:32:43.691730 28308 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb2b06452d04095b32eebac0eb7b30b (DEFAULT_TABLE table=test-table [id=97a028e186d64e26a4bbf46a3bbf3aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:43.692183 28499 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb2b06452d04095b32eebac0eb7b30b (DEFAULT_TABLE table=test-table [id=97a028e186d64e26a4bbf46a3bbf3aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:43.692183 28111 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb2b06452d04095b32eebac0eb7b30b (DEFAULT_TABLE table=test-table [id=97a028e186d64e26a4bbf46a3bbf3aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:43.693310 28308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb2b06452d04095b32eebac0eb7b30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:43.693605 28111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb2b06452d04095b32eebac0eb7b30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:43.693622 28499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb2b06452d04095b32eebac0eb7b30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:43.706090 28625 tablet_bootstrap.cc:492] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Bootstrap starting.
I20260812 00:32:43.708320 28628 tablet_bootstrap.cc:492] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Bootstrap starting.
I20260812 00:32:43.710575 28625 tablet_bootstrap.cc:654] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:43.711555 28627 tablet_bootstrap.cc:492] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Bootstrap starting.
I20260812 00:32:43.712440 28625 log.cc:824] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:43.712901 28628 tablet_bootstrap.cc:654] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:43.714035 28628 log.cc:824] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:43.714931 28627 tablet_bootstrap.cc:654] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:43.715937 28627 log.cc:824] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:43.716274 28625 tablet_bootstrap.cc:492] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: No bootstrap required, opened a new log
I20260812 00:32:43.716632 28625 ts_tablet_manager.cc:1397] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 00:32:43.718760 28628 tablet_bootstrap.cc:492] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: No bootstrap required, opened a new log
I20260812 00:32:43.719034 28628 ts_tablet_manager.cc:1397] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260812 00:32:43.719133 28627 tablet_bootstrap.cc:492] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: No bootstrap required, opened a new log
I20260812 00:32:43.719384 28627 ts_tablet_manager.cc:1397] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 00:32:43.726505 28628 raft_consensus.cc:348] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.726933 28628 raft_consensus.cc:374] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:43.727026 28628 raft_consensus.cc:729] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b7666208824a6890cc54755829c244, State: Initialized, Role: FOLLOWER
I20260812 00:32:43.727421 28625 raft_consensus.cc:348] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.727890 28625 raft_consensus.cc:374] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:43.727994 28625 raft_consensus.cc:729] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b53081167e64180b47a9e5f7f3a5918, State: Initialized, Role: FOLLOWER
I20260812 00:32:43.727807 28628 consensus_queue.cc:260] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.728588 28625 consensus_queue.cc:260] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.729868 28628 ts_tablet_manager.cc:1428] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260812 00:32:43.730340 28627 raft_consensus.cc:348] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.731108 28403 heartbeater.cc:503] Master 127.29.190.190:43295 was elected leader, sending a full tablet report...
I20260812 00:32:43.731761 28625 ts_tablet_manager.cc:1428] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260812 00:32:43.730815 28627 raft_consensus.cc:374] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:43.732076 28627 raft_consensus.cc:729] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e345151de147448b9fed30691f985c, State: Initialized, Role: FOLLOWER
I20260812 00:32:43.732784 28627 consensus_queue.cc:260] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.733920 28599 heartbeater.cc:503] Master 127.29.190.190:43295 was elected leader, sending a full tablet report...
I20260812 00:32:43.734627 28627 ts_tablet_manager.cc:1428] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Time spent starting tablet: real 0.015s user 0.011s sys 0.002s
W20260812 00:32:43.741137 28207 tablet.cc:2369] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:32:43.799842 28405 tablet.cc:2369] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 00:32:43.843068 28600 tablet.cc:2369] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:32:43.913211 28637 raft_consensus.cc:482] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:43.913612 28637 raft_consensus.cc:504] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.915637 28637 leader_election.cc:288] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76b7666208824a6890cc54755829c244 (127.29.190.129:46615), 3b53081167e64180b47a9e5f7f3a5918 (127.29.190.130:33331)
I20260812 00:32:43.917120 28636 raft_consensus.cc:482] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:43.917616 28636 raft_consensus.cc:504] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.919880 28636 leader_election.cc:288] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e345151de147448b9fed30691f985c (127.29.190.131:45793), 76b7666208824a6890cc54755829c244 (127.29.190.129:46615)
I20260812 00:32:43.924074 28604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.915981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:46615 (local address 127.29.190.131:47133)
0812 00:32:43.916328 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.916349 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.916482 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.916935 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.916952 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.916987 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:43.917415 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.917431 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.919179 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.919184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.921306 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.921322 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.923202 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.923209 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.923482 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.923535 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.923622 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.923762 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":3}
I20260812 00:32:43.924765 28619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.916091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:47133 (local address 127.29.190.129:46615)
0812 00:32:43.916363 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.916372 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.916424 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:32:43.916696 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.916701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.916765 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.916886 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:43.917917 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.919005 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.921540 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.922886 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.923030 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.923106 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.924360 (+ 1254us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.924496 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260812 00:32:43.925751 28143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb2b06452d04095b32eebac0eb7b30b" candidate_uuid: "23e345151de147448b9fed30691f985c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b7666208824a6890cc54755829c244" is_pre_election: true
I20260812 00:32:43.925989 28623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.916285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:50565 (local address 127.29.190.130:33331)
0812 00:32:43.916635 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.916641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.917074 (+ 433us) server_negotiation.cc:407] Connection header received
0812 00:32:43.917608 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.917612 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.917675 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.917726 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:43.918580 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.919678 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.923512 (+ 3834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.924776 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.924908 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.924975 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.925562 (+ 587us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.925704 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
I20260812 00:32:43.926388 28143 raft_consensus.cc:2454] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e345151de147448b9fed30691f985c in term 0.
I20260812 00:32:43.926709 28639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.915981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:33331 (local address 127.29.190.131:50565)
0812 00:32:43.916967 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.916984 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.917374 (+ 390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.917930 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.917934 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.917959 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:43.918362 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.918375 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.919888 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.919896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.923292 (+ 3396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.923306 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.925164 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.925170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.925359 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.925401 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.926176 (+ 775us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.926302 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":1190,"thread_start_us":519,"threads_started":1}
I20260812 00:32:43.927328 28436 leader_election.cc:302] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e345151de147448b9fed30691f985c, 76b7666208824a6890cc54755829c244; no voters:
I20260812 00:32:43.927837 28637 raft_consensus.cc:2781] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:32:43.927747 28334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb2b06452d04095b32eebac0eb7b30b" candidate_uuid: "23e345151de147448b9fed30691f985c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b53081167e64180b47a9e5f7f3a5918" is_pre_election: true
I20260812 00:32:43.927992 28637 raft_consensus.cc:482] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:32:43.928112 28637 raft_consensus.cc:3037] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:43.928340 28334 raft_consensus.cc:2454] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e345151de147448b9fed30691f985c in term 0.
I20260812 00:32:43.931408 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.920668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:46663 (local address 127.29.190.131:45793)
0812 00:32:43.920872 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.920879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.921196 (+ 317us) server_negotiation.cc:407] Connection header received
0812 00:32:43.921473 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.921478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.921558 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.921621 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:43.922568 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.924130 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.929050 (+ 4920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.930307 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.930403 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.930447 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.931049 (+ 602us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.931176 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 00:32:43.931708 28641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.920192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:45793 (local address 127.29.190.130:46663)
0812 00:32:43.921094 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.921114 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.921307 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.921853 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.921861 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.921897 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:43.922356 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.922370 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.924602 (+ 2232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.924610 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.928783 (+ 4173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.928802 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.930646 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.930653 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.930866 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.930904 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.931008 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.931220 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":58,"thread_start_us":849,"threads_started":1}
I20260812 00:32:43.931720 28637 raft_consensus.cc:504] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.932593 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb2b06452d04095b32eebac0eb7b30b" candidate_uuid: "3b53081167e64180b47a9e5f7f3a5918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e345151de147448b9fed30691f985c" is_pre_election: true
I20260812 00:32:43.932884 28143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb2b06452d04095b32eebac0eb7b30b" candidate_uuid: "23e345151de147448b9fed30691f985c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b7666208824a6890cc54755829c244"
I20260812 00:32:43.933102 28533 raft_consensus.cc:2379] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b53081167e64180b47a9e5f7f3a5918 in current term 1: Already voted for candidate 23e345151de147448b9fed30691f985c in this term.
I20260812 00:32:43.933017 28334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb2b06452d04095b32eebac0eb7b30b" candidate_uuid: "23e345151de147448b9fed30691f985c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b53081167e64180b47a9e5f7f3a5918"
I20260812 00:32:43.933125 28143 raft_consensus.cc:3037] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:43.933221 28334 raft_consensus.cc:3037] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:43.935650 28640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.920392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:46615 (local address 127.29.190.130:35129)
0812 00:32:43.921380 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:43.921401 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:43.921509 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:43.928077 (+ 6568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:43.928082 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:43.928113 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:43.929121 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.929136 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.930673 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.930677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.932813 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:43.932827 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.934795 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.934801 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:43.934983 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.935033 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:32:43.935139 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 00:32:43.935274 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"thread_start_us":295,"threads_started":1}
I20260812 00:32:43.935703 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.921548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:35129 (local address 127.29.190.129:46615)
0812 00:32:43.927529 (+ 5981us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.927534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.927560 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:32:43.927617 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.927622 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.927697 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.927795 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:43.929345 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.930534 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.933031 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.934554 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.934748 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.934831 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.935182 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.935321 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5757,"thread_start_us":4965,"threads_started":1}
I20260812 00:32:43.936183 28637 leader_election.cc:288] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [CANDIDATE]: Term 1 election: Requested vote from peers 76b7666208824a6890cc54755829c244 (127.29.190.129:46615), 3b53081167e64180b47a9e5f7f3a5918 (127.29.190.130:33331)
I20260812 00:32:43.936172 28334 raft_consensus.cc:2454] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e345151de147448b9fed30691f985c in term 1.
I20260812 00:32:43.936569 28437 leader_election.cc:302] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e345151de147448b9fed30691f985c, 3b53081167e64180b47a9e5f7f3a5918; no voters:
I20260812 00:32:43.936621 28143 raft_consensus.cc:2454] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e345151de147448b9fed30691f985c in term 1.
I20260812 00:32:43.936700 28141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb2b06452d04095b32eebac0eb7b30b" candidate_uuid: "3b53081167e64180b47a9e5f7f3a5918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76b7666208824a6890cc54755829c244" is_pre_election: true
I20260812 00:32:43.936940 28637 raft_consensus.cc:2781] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:43.937177 28141 raft_consensus.cc:2379] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b53081167e64180b47a9e5f7f3a5918 in current term 1: Already voted for candidate 23e345151de147448b9fed30691f985c in this term.
I20260812 00:32:43.937836 28637 raft_consensus.cc:686] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 1 LEADER]: Becoming Leader. State: Replica: 23e345151de147448b9fed30691f985c, State: Running, Role: LEADER
I20260812 00:32:43.937970 28244 leader_election.cc:302] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b53081167e64180b47a9e5f7f3a5918; no voters: 23e345151de147448b9fed30691f985c, 76b7666208824a6890cc54755829c244
I20260812 00:32:43.938400 28636 raft_consensus.cc:2726] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 00:32:43.938473 28637 consensus_queue.cc:237] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } }
I20260812 00:32:43.943681 27924 catalog_manager.cc:5495] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e345151de147448b9fed30691f985c (127.29.190.131). New cstate: current_term: 1 leader_uuid: "23e345151de147448b9fed30691f985c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e345151de147448b9fed30691f985c" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 45793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 } health_report { overall_health: UNKNOWN } } }
I20260812 00:32:43.989871 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:43.983680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43898 (local address 127.29.190.131:45793)
0812 00:32:43.983908 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:43.983914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:43.984049 (+ 135us) server_negotiation.cc:407] Connection header received
0812 00:32:43.984316 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:43.984320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:43.984456 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:43.984629 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:32:43.985041 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.985821 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.987539 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:43.987961 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:43.988108 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:43.988639 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:32:43.989195 (+ 556us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:32:43.989366 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:43.989470 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 00:32:43.989558 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 00:32:43.999332 28334 raft_consensus.cc:1261] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 1 FOLLOWER]: Refusing update from remote peer 23e345151de147448b9fed30691f985c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:43.999420 28141 raft_consensus.cc:1261] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 1 FOLLOWER]: Refusing update from remote peer 23e345151de147448b9fed30691f985c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:44.000351 28637 consensus_queue.cc:1035] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b53081167e64180b47a9e5f7f3a5918" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:44.000686 28643 consensus_queue.cc:1035] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [LEADER]: Connected to new peer: Peer: permanent_uuid: "76b7666208824a6890cc54755829c244" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:44.012748 28646 mvcc.cc:205] Tried to move back new op lower bound from 7317482553328046080 to 7317482553096560640. Current Snapshot: MvccSnapshot[applied={T|T < 7317482553328046080}]
I20260812 00:32:44.027798 27924 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:44.028121 27924 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:44.032371 27924 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7c2757d4ef234dae972d71506a37a9c0: Sending DeleteTablet for 3 replicas of tablet 0bb2b06452d04095b32eebac0eb7b30b
I20260812 00:32:44.033668 28499 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bb2b06452d04095b32eebac0eb7b30b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:44 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:43890
I20260812 00:32:44.033726 28308 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bb2b06452d04095b32eebac0eb7b30b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:44 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:57524
I20260812 00:32:44.034432 28111 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bb2b06452d04095b32eebac0eb7b30b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:44 UTC) from {username='kudu', principal='kudu/127.29.190.190@KRBTEST.COM'} at 127.0.0.1:48178
I20260812 00:32:44.034813 28661 tablet_replica.cc:330] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: stopping tablet replica
I20260812 00:32:44.035467 28661 raft_consensus.cc:2229] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:32:44.036360 28661 raft_consensus.cc:2258] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:44.037935 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 28010
I20260812 00:32:44.039425 28661 ts_tablet_manager.cc:1905] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:44.045212 28663 tablet_replica.cc:330] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: stopping tablet replica
I20260812 00:32:44.045917 28663 raft_consensus.cc:2229] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:44.046463 28663 raft_consensus.cc:2258] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:44.048275 28661 ts_tablet_manager.cc:1918] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:44.048514 28661 log.cc:1196] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/0bb2b06452d04095b32eebac0eb7b30b
I20260812 00:32:44.048787 28663 ts_tablet_manager.cc:1905] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:44.049219 28661 ts_tablet_manager.cc:1939] T 0bb2b06452d04095b32eebac0eb7b30b P 23e345151de147448b9fed30691f985c: Deleting consensus metadata
I20260812 00:32:44.051043 27903 catalog_manager.cc:4841] TS 23e345151de147448b9fed30691f985c (127.29.190.131:45793): tablet 0bb2b06452d04095b32eebac0eb7b30b (table test-table [id=97a028e186d64e26a4bbf46a3bbf3aed]) successfully deleted
I20260812 00:32:44.055816 28663 ts_tablet_manager.cc:1918] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:44.055994 28663 log.cc:1196] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/0bb2b06452d04095b32eebac0eb7b30b
I20260812 00:32:44.056581 28663 ts_tablet_manager.cc:1939] T 0bb2b06452d04095b32eebac0eb7b30b P 76b7666208824a6890cc54755829c244: Deleting consensus metadata
I20260812 00:32:44.058569 27907 catalog_manager.cc:4841] TS 76b7666208824a6890cc54755829c244 (127.29.190.129:46615): tablet 0bb2b06452d04095b32eebac0eb7b30b (table test-table [id=97a028e186d64e26a4bbf46a3bbf3aed]) successfully deleted
I20260812 00:32:44.066362 28662 tablet_replica.cc:330] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: stopping tablet replica
I20260812 00:32:44.066849 28662 raft_consensus.cc:2229] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:44.067420 28662 raft_consensus.cc:2258] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:44.070443 28662 ts_tablet_manager.cc:1905] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 00:32:44 dist-test-slave-c12x krb5kdc[27860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.129@KRBTEST.COM
I20260812 00:32:44.079353 28662 ts_tablet_manager.cc:1918] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:44.079586 28662 log.cc:1196] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/0bb2b06452d04095b32eebac0eb7b30b
I20260812 00:32:44.080153 28662 ts_tablet_manager.cc:1939] T 0bb2b06452d04095b32eebac0eb7b30b P 3b53081167e64180b47a9e5f7f3a5918: Deleting consensus metadata
I20260812 00:32:44.081930 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:44.038998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.29.190.129:46615)
0812 00:32:44.039221 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:44.039231 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:44.060062 (+ 20831us) server_negotiation.cc:407] Connection header received
0812 00:32:44.060353 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:44.060359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:44.060449 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:44.060535 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:44.062404 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:44.063565 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:44.067659 (+ 4094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:44.068297 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:44.068389 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:44.074399 (+ 6010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:44.074419 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:44.074439 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:44.074489 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:44.078444 (+ 3955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:44.079601 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:44.079612 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:44.079616 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:44.079816 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:44.080255 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:44.080262 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:44.080266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:44.080660 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:44.080983 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:44.081316 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 00:32:44.081568 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:32:44.082222 27908 catalog_manager.cc:4841] TS 3b53081167e64180b47a9e5f7f3a5918 (127.29.190.130:33331): tablet 0bb2b06452d04095b32eebac0eb7b30b (table test-table [id=97a028e186d64e26a4bbf46a3bbf3aed]) successfully deleted
I20260812 00:32:44.082690 28200 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:44.176131 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 28010
I20260812 00:32:44.213056 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 28220
Aug 12 00:32:44 dist-test-slave-c12x krb5kdc[27860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.130@KRBTEST.COM
I20260812 00:32:44.232316 28623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:44.213872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57538 (local address 127.29.190.130:33331)
0812 00:32:44.214055 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:44.214059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:44.214119 (+ 60us) server_negotiation.cc:407] Connection header received
0812 00:32:44.214325 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:44.214329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:44.214406 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:44.214485 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:44.216217 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:44.216957 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:44.218827 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:44.219199 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:44.219319 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:44.225109 (+ 5790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:44.225130 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:44.225148 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:44.225196 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:44.228755 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:44.229653 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:44.229663 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:44.229665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:44.229830 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:44.230307 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:44.230313 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:44.230319 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:44.230742 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:44.231101 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:44.231508 (+ 407us) server_negotiation.cc:299] Negotiation successful
0812 00:32:44.231773 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 00:32:44.233094 28395 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:44.329807 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 28220
I20260812 00:32:44.362677 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 28411
Aug 12 00:32:44 dist-test-slave-c12x krb5kdc[27860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.131@KRBTEST.COM
I20260812 00:32:44.379853 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:44.363657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43902 (local address 127.29.190.131:45793)
0812 00:32:44.363877 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:44.363883 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:44.363904 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:32:44.364039 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:44.364046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:44.364127 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:44.364246 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:44.365642 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:44.366380 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:44.367776 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:44.368235 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:44.368396 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:44.373390 (+ 4994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:44.373408 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:44.373425 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:44.373481 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:44.376789 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:44.377552 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:44.377563 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:44.377565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:44.377704 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:44.378129 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:44.378133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:44.378135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:44.378579 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:44.378915 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:44.379220 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 00:32:44.379490 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:32:44.380705 28592 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:44.505199 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 28411
I20260812 00:32:44.533963 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 27880
I20260812 00:32:44.535035 27965 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:44.645903 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 27880
2026-08-12T00:32:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4989 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T00:32:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:44Z Disabled control of system clock
I20260812 00:32:44.748157 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42537
--webserver_interface=127.29.190.190
--webserver_port=0
--builtin_ntp_servers=127.29.190.148:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:42537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:32:45.100155 28680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:45.100536 28680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:45.100705 28680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:45.108479 28680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:45.108642 28680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:45.108743 28680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:45.108867 28680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:45.108951 28680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:45.118716 28680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:42537
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:45.120183 28680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:45.122073 28680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:45.134375 28686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:45.134356 28687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:45.134406 28689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:45.135473 28680 server_base.cc:1034] running on GCE node
I20260812 00:32:45.136406 28680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:45.137917 28680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:45.139173 28680 hybrid_clock.cc:648] HybridClock initialized: now 1786494765139118 us; error 63 us; skew 500 ppm
I20260812 00:32:45.139599 28680 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:45.146787 28680 webserver.cc:460] Webserver started at http://127.29.190.190:35571/ using document root <none> and password file <none>
I20260812 00:32:45.147639 28680 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:45.147779 28680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:45.148144 28680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:45.151144 28680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "5314bd9cdda045f1875ef17feb0059a1"
format_stamp: "Formatted at 2026-08-12 00:32:45 on dist-test-slave-c12x"
server_key: "135e5da125bd99c3cffe49780c8ee63c"
server_key_iv: "0f7447117205cbe80e72980b0f63318a"
server_key_version: "encryptionkey@0"
I20260812 00:32:45.152065 28680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "5314bd9cdda045f1875ef17feb0059a1"
format_stamp: "Formatted at 2026-08-12 00:32:45 on dist-test-slave-c12x"
server_key: "135e5da125bd99c3cffe49780c8ee63c"
server_key_iv: "0f7447117205cbe80e72980b0f63318a"
server_key_version: "encryptionkey@0"
I20260812 00:32:45.157218 28680 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:32:45.160665 28697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:45.162002 28680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:32:45.162215 28680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "5314bd9cdda045f1875ef17feb0059a1"
format_stamp: "Formatted at 2026-08-12 00:32:45 on dist-test-slave-c12x"
server_key: "135e5da125bd99c3cffe49780c8ee63c"
server_key_iv: "0f7447117205cbe80e72980b0f63318a"
server_key_version: "encryptionkey@0"
I20260812 00:32:45.162446 28680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:45.177199 28680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:45.178095 28680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:45.178421 28680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:45.198182 28680 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:42537
I20260812 00:32:45.198203 28766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:42537 every 8 connection(s)
I20260812 00:32:45.199878 28680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:45.203796 28767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:45.209659 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 28680
I20260812 00:32:45.209844 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:45.210436 30458 external_mini_cluster.cc:1428] Setting key 3974778b0f97b3e9e5d4635226a4cc16
I20260812 00:32:45.215319 28767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1: Bootstrap starting.
I20260812 00:32:45.218439 28767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:45.219569 28767 log.cc:824] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:45.223045 28767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1: No bootstrap required, opened a new log
I20260812 00:32:45.225833 28771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:45.212606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47686 (local address 127.29.190.190:42537)
0812 00:32:45.213742 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:45.213753 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:45.213799 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:32:45.215776 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:45.215807 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:45.216272 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:45.216717 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:45.217318 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:45.218736 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:45.220553 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:45.221447 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:45.221634 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:45.222866 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:45.222877 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:45.222894 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:45.223678 (+ 784us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:45.223792 (+ 114us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:45.223822 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:45.223992 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:45.224237 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 00:32:45.224563 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":428,"threads_started":1}
I20260812 00:32:45.232088 28767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5314bd9cdda045f1875ef17feb0059a1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42537 } }
I20260812 00:32:45.232424 28767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:45.232510 28767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5314bd9cdda045f1875ef17feb0059a1, State: Initialized, Role: FOLLOWER
I20260812 00:32:45.232990 28767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5314bd9cdda045f1875ef17feb0059a1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42537 } }
I20260812 00:32:45.233191 28767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:45.233289 28767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:45.233415 28767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:45.235952 28767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5314bd9cdda045f1875ef17feb0059a1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42537 } }
I20260812 00:32:45.236415 28767 leader_election.cc:302] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5314bd9cdda045f1875ef17feb0059a1; no voters:
I20260812 00:32:45.236953 28767 leader_election.cc:288] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:45.237170 28773 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:45.238022 28773 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [term 1 LEADER]: Becoming Leader. State: Replica: 5314bd9cdda045f1875ef17feb0059a1, State: Running, Role: LEADER
I20260812 00:32:45.238574 28773 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5314bd9cdda045f1875ef17feb0059a1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42537 } }
I20260812 00:32:45.239037 28767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:45.241837 28777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5314bd9cdda045f1875ef17feb0059a1. Latest consensus state: current_term: 1 leader_uuid: "5314bd9cdda045f1875ef17feb0059a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5314bd9cdda045f1875ef17feb0059a1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42537 } } }
I20260812 00:32:45.241878 28774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5314bd9cdda045f1875ef17feb0059a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5314bd9cdda045f1875ef17feb0059a1" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42537 } } }
I20260812 00:32:45.242442 28777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:45.242509 28774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:45.244609 28783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:45.250337 28783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:45.259497 28783 catalog_manager.cc:1347] Generated new cluster ID: 7224421cdb6a41db902e37117f6b5a42
I20260812 00:32:45.259658 28783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:45.273245 28783 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:45.274592 28783 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:45.284399 28783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1: Generated new TSK 0
I20260812 00:32:45.285463 28783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:32:45.298120 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.129:0
--local_ip_for_outbound_sockets=127.29.190.129
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42537
--builtin_ntp_servers=127.29.190.148:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 00:32:45.668823 28804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:45.669127 28804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:45.669302 28804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:45.677038 28804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:45.677146 28804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:45.677342 28804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.129
I20260812 00:32:45.686892 28804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.190.129
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.129
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:45.688309 28804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:45.690213 28804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:45.704488 28811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:45.704492 28812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:45.704578 28816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:45.705794 28804 server_base.cc:1034] running on GCE node
I20260812 00:32:45.706425 28804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:45.707475 28804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:45.708729 28804 hybrid_clock.cc:648] HybridClock initialized: now 1786494765708668 us; error 55 us; skew 500 ppm
I20260812 00:32:45.709059 28804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:45.711361 28804 webserver.cc:460] Webserver started at http://127.29.190.129:46313/ using document root <none> and password file <none>
I20260812 00:32:45.712100 28804 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:45.712235 28804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:45.712572 28804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:45.715561 28804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/data/instance:
uuid: "fb16b73d45074f368d40e34edfa897dc"
format_stamp: "Formatted at 2026-08-12 00:32:45 on dist-test-slave-c12x"
server_key: "71229b8c7da40f252d7707fbca72e033"
server_key_iv: "4894af80c8f96d0d210eb674d9a1463c"
server_key_version: "encryptionkey@0"
I20260812 00:32:45.716368 28804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance:
uuid: "fb16b73d45074f368d40e34edfa897dc"
format_stamp: "Formatted at 2026-08-12 00:32:45 on dist-test-slave-c12x"
server_key: "71229b8c7da40f252d7707fbca72e033"
server_key_iv: "4894af80c8f96d0d210eb674d9a1463c"
server_key_version: "encryptionkey@0"
I20260812 00:32:45.721575 28804 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:32:45.725240 28826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:45.726686 28804 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:32:45.726871 28804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/wal
uuid: "fb16b73d45074f368d40e34edfa897dc"
format_stamp: "Formatted at 2026-08-12 00:32:45 on dist-test-slave-c12x"
server_key: "71229b8c7da40f252d7707fbca72e033"
server_key_iv: "4894af80c8f96d0d210eb674d9a1463c"
server_key_version: "encryptionkey@0"
I20260812 00:32:45.727097 28804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:45.760591 28804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:45.761597 28804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:45.761955 28804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:45.763046 28804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:45.764643 28804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:45.764770 28804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:45.764904 28804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:45.764993 28804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:45.801805 28804 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.129:42611
I20260812 00:32:45.801909 28996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.129:42611 every 8 connection(s)
I20260812 00:32:45.803206 28804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/data/info.pb
I20260812 00:32:45.813103 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 28804
I20260812 00:32:45.813301 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/wal/instance
I20260812 00:32:45.813870 30458 external_mini_cluster.cc:1428] Setting key 5b08b1a6578e250f075d2dd1e058ca19
I20260812 00:32:45.817328 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.130:0
--local_ip_for_outbound_sockets=127.29.190.130
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42537
--builtin_ntp_servers=127.29.190.148:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:32:45.817847 29001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:45.806076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.129:51177 (local address 127.29.190.190:42537)
0812 00:32:45.806553 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:45.806558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:45.807723 (+ 1165us) server_negotiation.cc:407] Connection header received
0812 00:32:45.809639 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:45.809646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:45.809762 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:45.809890 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:45.811112 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:45.811938 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:45.814335 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:45.814973 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:45.815241 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:45.816907 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:45.816912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:45.816915 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:45.816934 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:45.816981 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:45.816993 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:45.817075 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:45.817368 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 00:32:45.817502 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":249,"threads_started":1}
I20260812 00:32:45.819402 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:45.806588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42537 (local address 127.29.190.129:51177)
0812 00:32:45.807563 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:45.807604 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:45.809322 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:45.810152 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:45.810162 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:45.810257 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:45.810910 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:45.810929 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:45.812132 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:45.812136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:45.814126 (+ 1990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:45.814144 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:45.815356 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:45.815364 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:45.815695 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:45.816492 (+ 797us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:45.816495 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:45.816568 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:45.816690 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:45.817114 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:45.817128 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:45.817140 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 00:32:45.817363 (+ 223us) client_negotiation.cc:240] Negotiation successful
0812 00:32:45.817859 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":278,"threads_started":1}
I20260812 00:32:45.821043 28997 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42537
I20260812 00:32:45.821369 28997 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:45.822139 28997 heartbeater.cc:511] Master 127.29.190.190:42537 requested a full tablet report, sending...
I20260812 00:32:45.824316 28718 ts_manager.cc:194] Registered new tserver with Master: fb16b73d45074f368d40e34edfa897dc (127.29.190.129:42611)
I20260812 00:32:45.825850 28718 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.129:51177
W20260812 00:32:46.183573 29003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:46.183858 29003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:46.184013 29003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:46.191535 29003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:46.191646 29003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:46.191812 29003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.130
I20260812 00:32:46.201421 29003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.190.130
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.130
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:46.202778 29003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:46.204651 29003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:46.218356 29016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:46.218390 29012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:46.218303 29014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:46.219230 29003 server_base.cc:1034] running on GCE node
I20260812 00:32:46.219972 29003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:46.220966 29003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:46.222229 29003 hybrid_clock.cc:648] HybridClock initialized: now 1786494766222173 us; error 65 us; skew 500 ppm
I20260812 00:32:46.222599 29003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:46.225150 29003 webserver.cc:460] Webserver started at http://127.29.190.130:40079/ using document root <none> and password file <none>
I20260812 00:32:46.225903 29003 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:46.226040 29003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:46.226379 29003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:46.229450 29003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/data/instance:
uuid: "c7e11996517247bcbb4f0ca1025047a7"
format_stamp: "Formatted at 2026-08-12 00:32:46 on dist-test-slave-c12x"
server_key: "665665cc181255acc74e3d3d9a31fa83"
server_key_iv: "8dd1cf1a4849b17ec708e21342dd5523"
server_key_version: "encryptionkey@0"
I20260812 00:32:46.230271 29003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance:
uuid: "c7e11996517247bcbb4f0ca1025047a7"
format_stamp: "Formatted at 2026-08-12 00:32:46 on dist-test-slave-c12x"
server_key: "665665cc181255acc74e3d3d9a31fa83"
server_key_iv: "8dd1cf1a4849b17ec708e21342dd5523"
server_key_version: "encryptionkey@0"
I20260812 00:32:46.237583 29003 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260812 00:32:46.241761 29023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:46.243237 29003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:32:46.243521 29003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/wal
uuid: "c7e11996517247bcbb4f0ca1025047a7"
format_stamp: "Formatted at 2026-08-12 00:32:46 on dist-test-slave-c12x"
server_key: "665665cc181255acc74e3d3d9a31fa83"
server_key_iv: "8dd1cf1a4849b17ec708e21342dd5523"
server_key_version: "encryptionkey@0"
I20260812 00:32:46.243804 29003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:46.267940 29003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:46.268905 29003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:46.269292 29003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:46.270428 29003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:46.272119 29003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:46.272257 29003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:46.272414 29003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:46.272516 29003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:46.307416 29003 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.130:42513
I20260812 00:32:46.307529 29195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.130:42513 every 8 connection(s)
I20260812 00:32:46.308940 29003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/data/info.pb
I20260812 00:32:46.314642 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 29003
I20260812 00:32:46.314826 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/wal/instance
I20260812 00:32:46.315457 30458 external_mini_cluster.cc:1428] Setting key 4c7c4fe632387f86ed641717b01bd0a9
I20260812 00:32:46.318671 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.190.131:0
--local_ip_for_outbound_sockets=127.29.190.131
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42537
--builtin_ntp_servers=127.29.190.148:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 00:32:46.323696 29001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.311600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.130:53975 (local address 127.29.190.190:42537)
0812 00:32:46.311824 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.311830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.313257 (+ 1427us) server_negotiation.cc:407] Connection header received
0812 00:32:46.315584 (+ 2327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.315590 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.315682 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.315830 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:46.317117 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.318098 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.320695 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.321108 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.321209 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.322873 (+ 1664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:46.322878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:46.322881 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:46.322899 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:46.322933 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:46.322944 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:46.323017 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.323277 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.323361 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:32:46.325172 29198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.312200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42537 (local address 127.29.190.130:53975)
0812 00:32:46.313099 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:46.313136 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:46.315215 (+ 2079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:46.316122 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:46.316131 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:46.316226 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:46.316935 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.316952 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.318292 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.318300 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.320540 (+ 2240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.320561 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.321339 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.321349 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.321692 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.322473 (+ 781us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:46.322479 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:46.322544 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:46.322662 (+ 118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:46.323046 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:46.323059 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:46.323069 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 00:32:46.323260 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 00:32:46.323743 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":285,"threads_started":1}
I20260812 00:32:46.326725 29196 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42537
I20260812 00:32:46.327071 29196 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:46.328064 29196 heartbeater.cc:511] Master 127.29.190.190:42537 requested a full tablet report, sending...
I20260812 00:32:46.329741 28718 ts_manager.cc:194] Registered new tserver with Master: c7e11996517247bcbb4f0ca1025047a7 (127.29.190.130:42513)
I20260812 00:32:46.330588 28718 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.130:53975
W20260812 00:32:46.664736 29203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:46.665017 29203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:46.665184 29203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:46.672505 29203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:46.672598 29203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:46.672802 29203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.190.131
I20260812 00:32:46.681627 29203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.190.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.190.131
--webserver_port=0
--tserver_master_addrs=127.29.190.190:42537
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.190.131
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:46.682937 29203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:46.684770 29203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:46.697717 29213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:46.698459 29212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:46.698634 29216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:46.699556 29203 server_base.cc:1034] running on GCE node
I20260812 00:32:46.700208 29203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:46.701218 29203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:46.702481 29203 hybrid_clock.cc:648] HybridClock initialized: now 1786494766702429 us; error 51 us; skew 500 ppm
I20260812 00:32:46.702828 29203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 00:32:46.705181 29203 webserver.cc:460] Webserver started at http://127.29.190.131:35393/ using document root <none> and password file <none>
I20260812 00:32:46.705891 29203 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:46.706030 29203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:46.706369 29203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:46.709407 29203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/data/instance:
uuid: "f03b41ff52ac45a1bc64b3942127f3b4"
format_stamp: "Formatted at 2026-08-12 00:32:46 on dist-test-slave-c12x"
server_key: "54be5f280a6d70f6b54abfdfd36c66ca"
server_key_iv: "84ed625009b65cf69f139ab3cb4e7909"
server_key_version: "encryptionkey@0"
I20260812 00:32:46.710247 29203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance:
uuid: "f03b41ff52ac45a1bc64b3942127f3b4"
format_stamp: "Formatted at 2026-08-12 00:32:46 on dist-test-slave-c12x"
server_key: "54be5f280a6d70f6b54abfdfd36c66ca"
server_key_iv: "84ed625009b65cf69f139ab3cb4e7909"
server_key_version: "encryptionkey@0"
I20260812 00:32:46.715596 29203 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260812 00:32:46.719198 29226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:46.720618 29203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:32:46.720798 29203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/wal
uuid: "f03b41ff52ac45a1bc64b3942127f3b4"
format_stamp: "Formatted at 2026-08-12 00:32:46 on dist-test-slave-c12x"
server_key: "54be5f280a6d70f6b54abfdfd36c66ca"
server_key_iv: "84ed625009b65cf69f139ab3cb4e7909"
server_key_version: "encryptionkey@0"
I20260812 00:32:46.721022 29203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:46.752478 29203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:46.753342 29203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:46.753657 29203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:46.754650 29203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 00:32:46.756206 29203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 00:32:46.756330 29203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:46.756470 29203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 00:32:46.756562 29203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:46.792543 29203 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.131:43009
I20260812 00:32:46.792636 29394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.131:43009 every 8 connection(s)
I20260812 00:32:46.793934 29203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/data/info.pb
I20260812 00:32:46.802178 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 29203
I20260812 00:32:46.802373 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/wal/instance
I20260812 00:32:46.802806 30458 external_mini_cluster.cc:1428] Setting key 7e94750220475adc9f6095f5f9464ce0
I20260812 00:32:46.808259 29001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.796706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:33041 (local address 127.29.190.190:42537)
0812 00:32:46.796900 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.796905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.798323 (+ 1418us) server_negotiation.cc:407] Connection header received
0812 00:32:46.800361 (+ 2038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.800365 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.800437 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.800528 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:46.801716 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.802870 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.805219 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.805833 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.805932 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.807527 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:46.807535 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:46.807542 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:46.807569 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:46.807616 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:46.807634 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:46.807712 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.807926 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.808006 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 00:32:46.809221 29401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.797222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:42537 (local address 127.29.190.131:33041)
0812 00:32:46.798151 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:46.798195 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:46.800106 (+ 1911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:46.800748 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:46.800755 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:46.800837 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:32:46.801525 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.801545 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.803046 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.803052 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.805045 (+ 1993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.805062 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.806050 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.806058 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.806367 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.807121 (+ 754us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 00:32:46.807125 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:32:46.807178 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 00:32:46.807271 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:32:46.807737 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:32:46.807746 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:32:46.807752 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 00:32:46.807895 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 00:32:46.808186 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":277,"threads_started":1}
I20260812 00:32:46.810602 29395 heartbeater.cc:347] Connected to a master server at 127.29.190.190:42537
I20260812 00:32:46.810938 29395 heartbeater.cc:464] Registering TS with master...
I20260812 00:32:46.811722 29395 heartbeater.cc:511] Master 127.29.190.190:42537 requested a full tablet report, sending...
I20260812 00:32:46.813081 28718 ts_manager.cc:194] Registered new tserver with Master: f03b41ff52ac45a1bc64b3942127f3b4 (127.29.190.131:43009)
I20260812 00:32:46.813890 28718 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.190.131:33041
I20260812 00:32:46.817932 30458 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 00:32:46.827898 29001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.822005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45748 (local address 127.29.190.190:42537)
0812 00:32:46.822180 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.822185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.822688 (+ 503us) server_negotiation.cc:407] Connection header received
0812 00:32:46.822822 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.822826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.822882 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.822963 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:46.823407 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.824188 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.825684 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.826128 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.826224 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.827258 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:46.827262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:46.827265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:46.827282 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:46.827311 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:46.827321 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:46.827389 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.827596 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.827670 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 00:32:46.829123 28997 heartbeater.cc:503] Master 127.29.190.190:42537 was elected leader, sending a full tablet report...
I20260812 00:32:46.832170 28718 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45748:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 00:32:46.839044 28718 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 00:32:46.864744 29415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.852646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:42513 (local address 127.0.0.1:56354)
0812 00:32:46.855012 (+ 2366us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:46.855061 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:46.855364 (+ 303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:46.856566 (+ 1202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:46.856574 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:46.856603 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:46.857030 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.857042 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.859070 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.859078 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.861544 (+ 2466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.861558 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.863509 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.863517 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.863794 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.863864 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 00:32:46.864027 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 00:32:46.864255 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2086,"mutex_wait_us":30,"thread_start_us":1909,"threads_started":1}
I20260812 00:32:46.865819 29417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.852913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56354 (local address 127.29.190.130:42513)
0812 00:32:46.853617 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.853631 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.855190 (+ 1559us) server_negotiation.cc:407] Connection header received
0812 00:32:46.855691 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.855705 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.855981 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.856189 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:46.857274 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.858893 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.861771 (+ 2878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.863193 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.863390 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.863699 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.865189 (+ 1490us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.865413 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":363,"threads_started":1}
I20260812 00:32:46.866165 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.853818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46198 (local address 127.29.190.131:43009)
0812 00:32:46.854610 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.854621 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.856369 (+ 1748us) server_negotiation.cc:407] Connection header received
0812 00:32:46.856507 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.856536 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.856802 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.857034 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:46.857768 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.859701 (+ 1933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.862391 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.863979 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.864211 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.864452 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.865502 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.865700 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":353,"threads_started":1}
I20260812 00:32:46.865377 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.853152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.131:43009 (local address 127.0.0.1:46198)
0812 00:32:46.856061 (+ 2909us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:46.856085 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:46.856224 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:46.857030 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:46.857034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:46.857060 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:46.857459 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.857480 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.859883 (+ 2403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.859890 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.862153 (+ 2263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.862168 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.864603 (+ 2435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.864610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.864861 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.864897 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:32:46.864996 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 00:32:46.865147 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2750,"thread_start_us":2572,"threads_started":1}
I20260812 00:32:46.866888 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.856273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60692)
0812 00:32:46.857865 (+ 1592us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:46.857891 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:46.858036 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:46.859165 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:46.859169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:46.859195 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:46.859734 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.859755 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.861813 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.861818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.863867 (+ 2049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.863881 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.865936 (+ 2055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.865945 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.866149 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.866199 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 00:32:46.866300 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 00:32:46.866447 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1423,"mutex_wait_us":21,"thread_start_us":1262,"threads_started":1}
I20260812 00:32:46.867192 29421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.855888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60692 (local address 127.29.190.129:42611)
0812 00:32:46.858639 (+ 2751us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.858646 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.858671 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:32:46.858763 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.858768 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.858924 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.859177 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:46.859954 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.861641 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.864138 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.865671 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.865933 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.866155 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.866558 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.866731 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2577,"thread_start_us":2416,"threads_started":1}
I20260812 00:32:46.871065 28900 tablet_service.cc:1467] Processing CreateTablet for tablet 15192c87aacb48e9a1ee206d93102710 (DEFAULT_TABLE table=test-table [id=38ab2965f3ca4e56944fe35dd04ae47d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:46.871047 29099 tablet_service.cc:1467] Processing CreateTablet for tablet 15192c87aacb48e9a1ee206d93102710 (DEFAULT_TABLE table=test-table [id=38ab2965f3ca4e56944fe35dd04ae47d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:46.871045 29299 tablet_service.cc:1467] Processing CreateTablet for tablet 15192c87aacb48e9a1ee206d93102710 (DEFAULT_TABLE table=test-table [id=38ab2965f3ca4e56944fe35dd04ae47d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 00:32:46.872560 28900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15192c87aacb48e9a1ee206d93102710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:46.872655 29099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15192c87aacb48e9a1ee206d93102710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:46.872673 29299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15192c87aacb48e9a1ee206d93102710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:46.886463 29423 tablet_bootstrap.cc:492] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: Bootstrap starting.
I20260812 00:32:46.889035 29424 tablet_bootstrap.cc:492] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: Bootstrap starting.
I20260812 00:32:46.891353 29423 tablet_bootstrap.cc:654] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:46.892524 29426 tablet_bootstrap.cc:492] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: Bootstrap starting.
I20260812 00:32:46.893043 29424 tablet_bootstrap.cc:654] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:46.894572 29423 log.cc:824] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:46.894565 29424 log.cc:824] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:46.896396 29426 tablet_bootstrap.cc:654] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:46.897775 29426 log.cc:824] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:46.897858 29423 tablet_bootstrap.cc:492] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: No bootstrap required, opened a new log
I20260812 00:32:46.898185 29423 ts_tablet_manager.cc:1397] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.007s
I20260812 00:32:46.898388 29424 tablet_bootstrap.cc:492] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: No bootstrap required, opened a new log
I20260812 00:32:46.898723 29424 ts_tablet_manager.cc:1397] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 00:32:46.901190 29426 tablet_bootstrap.cc:492] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: No bootstrap required, opened a new log
I20260812 00:32:46.901492 29426 ts_tablet_manager.cc:1397] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260812 00:32:46.907266 29423 raft_consensus.cc:348] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.907904 29423 raft_consensus.cc:374] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:46.908063 29423 raft_consensus.cc:729] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb16b73d45074f368d40e34edfa897dc, State: Initialized, Role: FOLLOWER
I20260812 00:32:46.908793 29423 consensus_queue.cc:260] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.910261 29424 raft_consensus.cc:348] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.910800 29424 raft_consensus.cc:374] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:46.910837 29423 ts_tablet_manager.cc:1428] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260812 00:32:46.910950 29424 raft_consensus.cc:729] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b41ff52ac45a1bc64b3942127f3b4, State: Initialized, Role: FOLLOWER
I20260812 00:32:46.911674 29424 consensus_queue.cc:260] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.912879 29426 raft_consensus.cc:348] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.913390 29426 raft_consensus.cc:374] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:46.913514 29426 raft_consensus.cc:729] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e11996517247bcbb4f0ca1025047a7, State: Initialized, Role: FOLLOWER
I20260812 00:32:46.913618 29424 ts_tablet_manager.cc:1428] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260812 00:32:46.914120 29426 consensus_queue.cc:260] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.914660 29395 heartbeater.cc:503] Master 127.29.190.190:42537 was elected leader, sending a full tablet report...
I20260812 00:32:46.916208 29196 heartbeater.cc:503] Master 127.29.190.190:42537 was elected leader, sending a full tablet report...
I20260812 00:32:46.917624 29426 ts_tablet_manager.cc:1428] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: Time spent starting tablet: real 0.016s user 0.011s sys 0.006s
I20260812 00:32:46.943271 29431 raft_consensus.cc:482] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 00:32:46.943796 29431 raft_consensus.cc:504] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.945642 29431 leader_election.cc:288] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7e11996517247bcbb4f0ca1025047a7 (127.29.190.130:42513), fb16b73d45074f368d40e34edfa897dc (127.29.190.129:42611)
I20260812 00:32:46.951962 29401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.945976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.130:42513 (local address 127.29.190.131:50487)
0812 00:32:46.946175 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:46.946195 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:46.946331 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:46.946730 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:46.946735 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:46.946768 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:46.946960 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.946968 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.948420 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.948425 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.950109 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.950124 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.951195 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.951201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.951375 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.951411 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 00:32:46.951575 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 00:32:46.951700 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 00:32:46.952050 29417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.946102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:50487 (local address 127.29.190.130:42513)
0812 00:32:46.946293 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.946297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.946316 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:32:46.946491 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.946500 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.946593 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.946707 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:46.947185 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.948267 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.950263 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.950989 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.951169 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.951245 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.951636 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.951771 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 00:32:46.953164 29421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.946647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.190.131:49581 (local address 127.29.190.129:42611)
0812 00:32:46.946904 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.946911 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.947539 (+ 628us) server_negotiation.cc:407] Connection header received
0812 00:32:46.947664 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.947669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.947753 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.947849 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 00:32:46.948400 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.949139 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.951121 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.952298 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.952480 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.952555 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.952818 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.952939 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 00:32:46.953207 29434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.946425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.29.190.131:49581)
0812 00:32:46.947394 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:46.947409 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 00:32:46.947558 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:32:46.947869 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:32:46.947872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:32:46.947890 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 00:32:46.948238 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.948247 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.949287 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.949293 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.950932 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:32:46.950943 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.952476 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.952482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:32:46.952665 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.952687 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 00:32:46.952790 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 00:32:46.952912 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"thread_start_us":695,"threads_started":1}
I20260812 00:32:46.953133 29128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15192c87aacb48e9a1ee206d93102710" candidate_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7e11996517247bcbb4f0ca1025047a7" is_pre_election: true
I20260812 00:32:46.953855 29128 raft_consensus.cc:2454] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b41ff52ac45a1bc64b3942127f3b4 in term 0.
I20260812 00:32:46.954444 28928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15192c87aacb48e9a1ee206d93102710" candidate_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb16b73d45074f368d40e34edfa897dc" is_pre_election: true
I20260812 00:32:46.954711 29228 leader_election.cc:302] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7e11996517247bcbb4f0ca1025047a7, f03b41ff52ac45a1bc64b3942127f3b4; no voters:
I20260812 00:32:46.955029 28928 raft_consensus.cc:2454] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b41ff52ac45a1bc64b3942127f3b4 in term 0.
I20260812 00:32:46.955165 29431 raft_consensus.cc:2781] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 00:32:46.955380 29431 raft_consensus.cc:482] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 00:32:46.955559 29431 raft_consensus.cc:3037] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:46.957993 29431 raft_consensus.cc:504] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.958657 29431 leader_election.cc:288] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [CANDIDATE]: Term 1 election: Requested vote from peers c7e11996517247bcbb4f0ca1025047a7 (127.29.190.130:42513), fb16b73d45074f368d40e34edfa897dc (127.29.190.129:42611)
I20260812 00:32:46.959208 29128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15192c87aacb48e9a1ee206d93102710" candidate_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7e11996517247bcbb4f0ca1025047a7"
I20260812 00:32:46.959308 28928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15192c87aacb48e9a1ee206d93102710" candidate_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb16b73d45074f368d40e34edfa897dc"
I20260812 00:32:46.959462 29128 raft_consensus.cc:3037] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:46.959522 28928 raft_consensus.cc:3037] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:46.962800 29128 raft_consensus.cc:2454] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b41ff52ac45a1bc64b3942127f3b4 in term 1.
I20260812 00:32:46.962800 28928 raft_consensus.cc:2454] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b41ff52ac45a1bc64b3942127f3b4 in term 1.
I20260812 00:32:46.963210 29228 leader_election.cc:302] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f03b41ff52ac45a1bc64b3942127f3b4, fb16b73d45074f368d40e34edfa897dc; no voters:
I20260812 00:32:46.963575 29431 raft_consensus.cc:2781] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:46.964025 29431 raft_consensus.cc:686] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 1 LEADER]: Becoming Leader. State: Replica: f03b41ff52ac45a1bc64b3942127f3b4, State: Running, Role: LEADER
I20260812 00:32:46.964584 29431 consensus_queue.cc:237] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } }
I20260812 00:32:46.969463 28718 catalog_manager.cc:5495] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b41ff52ac45a1bc64b3942127f3b4 (127.29.190.131). New cstate: current_term: 1 leader_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b41ff52ac45a1bc64b3942127f3b4" member_type: VOTER last_known_addr { host: "127.29.190.131" port: 43009 } health_report { overall_health: HEALTHY } } }
I20260812 00:32:46.990711 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:46.985290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46210 (local address 127.29.190.131:43009)
0812 00:32:46.985483 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:46.985487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:46.985684 (+ 197us) server_negotiation.cc:407] Connection header received
0812 00:32:46.985836 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:46.985839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:46.985928 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:46.986070 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:32:46.986430 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.987150 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.988714 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:46.989151 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:46.989251 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:46.989730 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:32:46.990244 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:32:46.990357 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:46.990432 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 00:32:46.990497 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 00:32:46.999035 29128 raft_consensus.cc:1261] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 1 FOLLOWER]: Refusing update from remote peer f03b41ff52ac45a1bc64b3942127f3b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:46.999053 28928 raft_consensus.cc:1261] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 1 FOLLOWER]: Refusing update from remote peer f03b41ff52ac45a1bc64b3942127f3b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:32:47.000145 29435 consensus_queue.cc:1035] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb16b73d45074f368d40e34edfa897dc" member_type: VOTER last_known_addr { host: "127.29.190.129" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:47.000545 29431 consensus_queue.cc:1035] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7e11996517247bcbb4f0ca1025047a7" member_type: VOTER last_known_addr { host: "127.29.190.130" port: 42513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:32:47.012961 29443 mvcc.cc:205] Tried to move back new op lower bound from 7317482565617881088 to 7317482565491077120. Current Snapshot: MvccSnapshot[applied={T|T < 7317482565617881088}]
I20260812 00:32:47.014904 29442 mvcc.cc:205] Tried to move back new op lower bound from 7317482565617881088 to 7317482565491077120. Current Snapshot: MvccSnapshot[applied={T|T < 7317482565617881088}]
I20260812 00:32:47.032085 28718 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:47.032354 28718 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45748:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 00:32:47.036099 28718 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5314bd9cdda045f1875ef17feb0059a1: Sending DeleteTablet for 3 replicas of tablet 15192c87aacb48e9a1ee206d93102710
I20260812 00:32:47.037353 29299 tablet_service.cc:1514] Processing DeleteTablet for tablet 15192c87aacb48e9a1ee206d93102710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:47 UTC) from {username='slave'} at 127.0.0.1:46198
I20260812 00:32:47.037369 29099 tablet_service.cc:1514] Processing DeleteTablet for tablet 15192c87aacb48e9a1ee206d93102710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:47 UTC) from {username='slave'} at 127.0.0.1:56354
I20260812 00:32:47.038365 28900 tablet_service.cc:1514] Processing DeleteTablet for tablet 15192c87aacb48e9a1ee206d93102710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 00:32:47 UTC) from {username='slave'} at 127.0.0.1:60692
I20260812 00:32:47.038487 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 28804
I20260812 00:32:47.047147 29460 tablet_replica.cc:330] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: stopping tablet replica
I20260812 00:32:47.047817 29460 raft_consensus.cc:2229] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:47.048599 29460 raft_consensus.cc:2258] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:47.049583 29456 tablet_replica.cc:330] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: stopping tablet replica
I20260812 00:32:47.050081 29456 raft_consensus.cc:2229] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 00:32:47.050647 29456 raft_consensus.cc:2258] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:47.051591 29454 tablet_replica.cc:330] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: stopping tablet replica
I20260812 00:32:47.051960 29454 raft_consensus.cc:2229] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 00:32:47.053755 29460 ts_tablet_manager.cc:1905] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:47.054097 29456 ts_tablet_manager.cc:1905] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:47.059289 29421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.039711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60702 (local address 127.29.190.129:42611)
0812 00:32:47.039961 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:47.039970 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:47.045348 (+ 5378us) server_negotiation.cc:407] Connection header received
0812 00:32:47.051635 (+ 6287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:47.051642 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:47.051749 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:47.051871 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:47.052390 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:47.053538 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:47.055401 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:47.056065 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:47.056197 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:47.057489 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:47.057510 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:47.057529 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:47.058346 (+ 817us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:47.058415 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:47.058444 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:47.058584 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:47.058738 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 00:32:47.058872 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 00:32:47.060050 28991 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:47.060532 29456 ts_tablet_manager.cc:1918] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:47.060784 29456 log.cc:1196] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-1/wal/wals/15192c87aacb48e9a1ee206d93102710
I20260812 00:32:47.061329 29456 ts_tablet_manager.cc:1939] T 15192c87aacb48e9a1ee206d93102710 P c7e11996517247bcbb4f0ca1025047a7: Deleting consensus metadata
I20260812 00:32:47.061431 29454 raft_consensus.cc:2258] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 00:32:47.063406 28698 catalog_manager.cc:4841] TS c7e11996517247bcbb4f0ca1025047a7 (127.29.190.130:42513): tablet 15192c87aacb48e9a1ee206d93102710 (table test-table [id=38ab2965f3ca4e56944fe35dd04ae47d]) successfully deleted
I20260812 00:32:47.064069 29454 ts_tablet_manager.cc:1905] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 00:32:47.071815 29454 ts_tablet_manager.cc:1918] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:47.072049 29454 log.cc:1196] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-2/wal/wals/15192c87aacb48e9a1ee206d93102710
I20260812 00:32:47.072574 29454 ts_tablet_manager.cc:1939] T 15192c87aacb48e9a1ee206d93102710 P f03b41ff52ac45a1bc64b3942127f3b4: Deleting consensus metadata
I20260812 00:32:47.074229 28702 catalog_manager.cc:4841] TS f03b41ff52ac45a1bc64b3942127f3b4 (127.29.190.131:43009): tablet 15192c87aacb48e9a1ee206d93102710 (table test-table [id=38ab2965f3ca4e56944fe35dd04ae47d]) successfully deleted
I20260812 00:32:47.170421 29460 ts_tablet_manager.cc:1918] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 00:32:47.170588 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 28804
I20260812 00:32:47.170707 29460 log.cc:1196] T 15192c87aacb48e9a1ee206d93102710 P fb16b73d45074f368d40e34edfa897dc: Deleting WAL directory at /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786494426716583-30458-0/minicluster-data/ts-0/wal/wals/15192c87aacb48e9a1ee206d93102710
W20260812 00:32:47.197340 28698 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.190.129:42611 (error 108)
I20260812 00:32:47.197821 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 29003
I20260812 00:32:47.210707 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.210078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60716)
0812 00:32:47.210376 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:47.210521 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
W20260812 00:32:47.211215 28698 catalog_manager.cc:4584] TS fb16b73d45074f368d40e34edfa897dc (127.29.190.129:42611): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 15192c87aacb48e9a1ee206d93102710: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
I20260812 00:32:47.211463 29417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.199711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.29.190.130:42513)
0812 00:32:47.199951 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:47.199960 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:47.199986 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:32:47.200409 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:47.200418 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:47.200560 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:47.200678 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:47.201515 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:47.203045 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:47.206095 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:47.207001 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:47.207168 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:47.209205 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:47.209221 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:47.209241 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:47.210106 (+ 865us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:47.210175 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:47.210200 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:47.210312 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:47.210948 (+ 636us) server_negotiation.cc:299] Negotiation successful
0812 00:32:47.211073 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 00:32:47.212345 29190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:47.265239 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.264630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60728)
0812 00:32:47.264909 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:47.265044 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260812 00:32:47.266501 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.266066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60744)
0812 00:32:47.266275 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:47.266350 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260812 00:32:47.304471 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 29003
I20260812 00:32:47.327325 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.326672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60752)
0812 00:32:47.326935 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:47.327063 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 00:32:47.328771 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.328243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60768)
0812 00:32:47.328504 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:47.328613 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
I20260812 00:32:47.332172 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 29203
I20260812 00:32:47.340648 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.333042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46220 (local address 127.29.190.131:43009)
0812 00:32:47.333247 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:47.333253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:47.333342 (+ 89us) server_negotiation.cc:407] Connection header received
0812 00:32:47.333531 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:47.333535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:47.333617 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:47.333702 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:47.334226 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:47.335000 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:47.336903 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:47.337359 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:47.337462 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:47.338792 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:47.338801 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:47.338816 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:47.339760 (+ 944us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:47.339847 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:47.339884 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:47.339995 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:47.340157 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 00:32:47.340279 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:32:47.341535 29389 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:47.409839 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.409285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60774)
0812 00:32:47.409586 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:47.409682 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260812 00:32:47.411034 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.410635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60780)
0812 00:32:47.410850 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:47.410920 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260812 00:32:47.461850 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 29203
I20260812 00:32:47.491168 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 28680
I20260812 00:32:47.492414 28761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:47.602526 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:47.601749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.129:42611 (local address 127.0.0.1:60782)
0812 00:32:47.602109 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0812 00:32:47.602237 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.129:42611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260812 00:32:47.602833 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 28680
2026-08-12T00:32:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2957 ms)
[----------] 6 tests from EncryptionPolicyTest (23895 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:47 dist-test-slave-c12x krb5kdc[29478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:47 dist-test-slave-c12x krb5kdc[29478](info): set up 2 sockets
Aug 12 00:32:47 dist-test-slave-c12x krb5kdc[29478](info): commencing operation
krb5kdc: starting...
W20260812 00:32:48.969501 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.004s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:32:49 dist-test-slave-c12x krb5kdc[29478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:32:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:32:49.287968 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36195
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36195
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:49.645962 29500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:49.646278 29500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:49.646468 29500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:49.653874 29500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:49.653987 29500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:49.654109 29500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:49.654244 29500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:49.654325 29500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:49.664413 29500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36195
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:49.665714 29500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:49.667061 29500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:49.679150 29512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:49.679195 29509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:49.679414 29506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:49.680495 29500 server_base.cc:1034] running on GCE node
I20260812 00:32:49.681294 29500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:49.682729 29500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:49.683959 29500 hybrid_clock.cc:648] HybridClock initialized: now 1786494769683915 us; error 61 us; skew 500 ppm
I20260812 00:32:49.684312 29500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:49 dist-test-slave-c12x krb5kdc[29478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494769, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:49.687479 29500 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:32:49.688993 29500 webserver.cc:460] Webserver started at http://127.0.0.1:44857/ using document root <none> and password file <none>
I20260812 00:32:49.689749 29500 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:49.689901 29500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:49.690218 29500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:49.693408 29500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "8156b66d996e424a865f9daceab0b33c"
format_stamp: "Formatted at 2026-08-12 00:32:49 on dist-test-slave-c12x"
server_key: "176efc575bcfb132c4365763dd65055b"
server_key_iv: "564f0bcd149f5dbf750695f452ba6e56"
server_key_version: "encryptionkey@0"
I20260812 00:32:49.694278 29500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "8156b66d996e424a865f9daceab0b33c"
format_stamp: "Formatted at 2026-08-12 00:32:49 on dist-test-slave-c12x"
server_key: "176efc575bcfb132c4365763dd65055b"
server_key_iv: "564f0bcd149f5dbf750695f452ba6e56"
server_key_version: "encryptionkey@0"
I20260812 00:32:49.699858 29500 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 00:32:49.703402 29521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:49.704852 29500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:32:49.705050 29500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "8156b66d996e424a865f9daceab0b33c"
format_stamp: "Formatted at 2026-08-12 00:32:49 on dist-test-slave-c12x"
server_key: "176efc575bcfb132c4365763dd65055b"
server_key_iv: "564f0bcd149f5dbf750695f452ba6e56"
server_key_version: "encryptionkey@0"
I20260812 00:32:49.705260 29500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:49.723932 29500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:49.728287 29500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:49.728619 29500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:49.748847 29500 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36195
I20260812 00:32:49.748871 29600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36195 every 8 connection(s)
I20260812 00:32:49.750393 29500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:49.754249 29601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:49.759784 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 29500
I20260812 00:32:49.760010 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:49.760663 30458 external_mini_cluster.cc:1428] Setting key 3d44d67d71e59b18ee1c7d49f74f2f71
I20260812 00:32:49.765467 29601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c: Bootstrap starting.
I20260812 00:32:49.769456 29601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:49.770856 29601 log.cc:824] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:49.774186 29601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c: No bootstrap required, opened a new log
Aug 12 00:32:49 dist-test-slave-c12x krb5kdc[29478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:32:49.784474 29601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8156b66d996e424a865f9daceab0b33c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36195 } }
I20260812 00:32:49.785009 29601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:49.785136 29601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8156b66d996e424a865f9daceab0b33c, State: Initialized, Role: FOLLOWER
I20260812 00:32:49.785852 29601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8156b66d996e424a865f9daceab0b33c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36195 } }
I20260812 00:32:49.786212 29601 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:49.786408 29601 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:49.786634 29601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:49.788174 29605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:49.762916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34877 (local address 127.0.0.1:36195)
0812 00:32:49.763960 (+ 1044us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:49.763978 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:49.764431 (+ 453us) server_negotiation.cc:407] Connection header received
0812 00:32:49.766933 (+ 2502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:49.766962 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:49.767556 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:49.768057 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:49.769504 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:49.771623 (+ 2119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:49.773144 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:49.774178 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:49.774359 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:49.778734 (+ 4375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:49.778745 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:49.778766 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:49.778828 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:49.783004 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:49.783927 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:49.783935 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:49.783943 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:49.784163 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:49.784632 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:49.784637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:49.784640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:49.785419 (+ 779us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:49.785767 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:49.786259 (+ 492us) server_negotiation.cc:299] Negotiation successful
0812 00:32:49.786658 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":780,"thread_start_us":500,"threads_started":1}
I20260812 00:32:49.789685 29601 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8156b66d996e424a865f9daceab0b33c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36195 } }
I20260812 00:32:49.790241 29601 leader_election.cc:302] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8156b66d996e424a865f9daceab0b33c; no voters:
I20260812 00:32:49.790876 29601 leader_election.cc:288] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:49.791023 29608 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:49.792477 29608 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [term 1 LEADER]: Becoming Leader. State: Replica: 8156b66d996e424a865f9daceab0b33c, State: Running, Role: LEADER
I20260812 00:32:49.792744 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:32:49.793107 29608 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8156b66d996e424a865f9daceab0b33c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36195 } }
I20260812 00:32:49.793352 29601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:49.802412 29610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8156b66d996e424a865f9daceab0b33c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8156b66d996e424a865f9daceab0b33c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36195 } } }
I20260812 00:32:49.803828 29610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:49.803759 29612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8156b66d996e424a865f9daceab0b33c. Latest consensus state: current_term: 1 leader_uuid: "8156b66d996e424a865f9daceab0b33c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8156b66d996e424a865f9daceab0b33c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36195 } } }
I20260812 00:32:49.804087 29612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:49.814445 29626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:49.820752 29626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:49.828177 29605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:49.802912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45189 (local address 127.0.0.1:36195)
0812 00:32:49.803093 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:49.803098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:49.804597 (+ 1499us) server_negotiation.cc:407] Connection header received
0812 00:32:49.804930 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:49.804934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:49.805002 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:49.805062 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:49.807596 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:49.809181 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:49.811867 (+ 2686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:49.812793 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:49.812935 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:49.816794 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:49.816802 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:49.816809 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:49.816860 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:49.822287 (+ 5427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:49.823794 (+ 1507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:49.823806 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:49.823812 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:49.824034 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:49.824820 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:49.824832 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:49.824837 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:49.825440 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:49.827040 (+ 1600us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:49.827305 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 00:32:49.827612 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 00:32:49.834774 29626 catalog_manager.cc:1347] Generated new cluster ID: 116642beac514cdbaf93e7e39d6b29e8
I20260812 00:32:49.834916 29626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:49.855309 29626 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:49.857292 29626 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:49.868213 29626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8156b66d996e424a865f9daceab0b33c: Generated new TSK 0
I20260812 00:32:49.869572 29626 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:32:49.884275 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 29500
I20260812 00:32:49.885915 29596 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:49.978165 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 29500
W20260812 00:32:50.004032 29475 connection.cc:535] client connection to 127.0.0.1:36195 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36195): Connection reset by peer (error 104)
2026-08-12T00:32:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2366 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:50 dist-test-slave-c12x krb5kdc[29647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:50 dist-test-slave-c12x krb5kdc[29647](info): set up 2 sockets
Aug 12 00:32:50 dist-test-slave-c12x krb5kdc[29647](info): commencing operation
krb5kdc: starting...
W20260812 00:32:51.308581 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.003s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:32:51 dist-test-slave-c12x krb5kdc[29647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:32:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:32:51.638988 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42485
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:51.998211 29665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:51.998624 29665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:51.998804 29665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:52.006345 29665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:52.006529 29665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:52.006628 29665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:52.006747 29665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:52.006840 29665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:52.017093 29665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42485
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:52.018601 29665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:52.020186 29665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:52.032539 29677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:52.032517 29679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:52.032487 29682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:52.033476 29665 server_base.cc:1034] running on GCE node
I20260812 00:32:52.034313 29665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:52.035970 29665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:52.037221 29665 hybrid_clock.cc:648] HybridClock initialized: now 1786494772037166 us; error 51 us; skew 500 ppm
I20260812 00:32:52.037609 29665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:52 dist-test-slave-c12x krb5kdc[29647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494772, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:52.045317 29665 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:32:52.046984 29665 webserver.cc:460] Webserver started at http://127.0.0.1:45931/ using document root <none> and password file <none>
I20260812 00:32:52.047808 29665 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:52.047962 29665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:52.048276 29665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:52.051412 29665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "80abe6351e03425dba89ce2fd8faff9e"
format_stamp: "Formatted at 2026-08-12 00:32:52 on dist-test-slave-c12x"
server_key: "82c8b4ed8f683fa3ba73987c5af1586c"
server_key_iv: "7575aa035e42878025b8781b7364c1e0"
server_key_version: "encryptionkey@0"
I20260812 00:32:52.052278 29665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "80abe6351e03425dba89ce2fd8faff9e"
format_stamp: "Formatted at 2026-08-12 00:32:52 on dist-test-slave-c12x"
server_key: "82c8b4ed8f683fa3ba73987c5af1586c"
server_key_iv: "7575aa035e42878025b8781b7364c1e0"
server_key_version: "encryptionkey@0"
I20260812 00:32:52.057497 29665 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:32:52.061139 29698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:52.062458 29665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:32:52.062667 29665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "80abe6351e03425dba89ce2fd8faff9e"
format_stamp: "Formatted at 2026-08-12 00:32:52 on dist-test-slave-c12x"
server_key: "82c8b4ed8f683fa3ba73987c5af1586c"
server_key_iv: "7575aa035e42878025b8781b7364c1e0"
server_key_version: "encryptionkey@0"
I20260812 00:32:52.062876 29665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:52.077549 29665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:52.081852 29665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:52.082154 29665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:52.102035 29665 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42485
I20260812 00:32:52.102088 29780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42485 every 8 connection(s)
I20260812 00:32:52.103751 29665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:52.107949 29782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:52.111518 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 29665
I20260812 00:32:52.111706 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:52.112190 30458 external_mini_cluster.cc:1428] Setting key a8e29ec7a54215899059b25670db7246
I20260812 00:32:52.120052 29782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e: Bootstrap starting.
I20260812 00:32:52.123572 29782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:52.124795 29782 log.cc:824] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:52.125594 29787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:52.114026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49537 (local address 127.0.0.1:42485)
0812 00:32:52.114773 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:52.114785 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:52.114826 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:32:52.116579 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:52.116602 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:52.117019 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:52.117426 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:52.118005 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:52.119387 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:52.120826 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:52.121513 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:52.121737 (+ 224us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:52.123019 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:52.123027 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:52.123041 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:52.123650 (+ 609us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:52.123772 (+ 122us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:52.123800 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:52.123976 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:52.124271 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 00:32:52.124435 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":324,"threads_started":1}
I20260812 00:32:52.128159 29782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e: No bootstrap required, opened a new log
I20260812 00:32:52.129582 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:32:52.136876 29782 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80abe6351e03425dba89ce2fd8faff9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42485 } }
I20260812 00:32:52.137367 29782 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:52.137497 29782 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80abe6351e03425dba89ce2fd8faff9e, State: Initialized, Role: FOLLOWER
I20260812 00:32:52.138151 29782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80abe6351e03425dba89ce2fd8faff9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42485 } }
I20260812 00:32:52.138502 29782 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:52.138670 29782 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:52.138875 29782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:52.141137 29787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:52.134062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53469 (local address 127.0.0.1:42485)
0812 00:32:52.134321 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:52.134327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:52.134708 (+ 381us) server_negotiation.cc:407] Connection header received
0812 00:32:52.134888 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:52.134891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:52.134952 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:52.135030 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:52.135684 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:52.136438 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:52.138334 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:52.138975 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:52.139100 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:52.140319 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:52.140323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:52.140326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:52.140343 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:52.140403 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:52.140421 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:52.140502 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:52.140730 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 00:32:52.140794 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:32:52.141966 29782 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80abe6351e03425dba89ce2fd8faff9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42485 } }
I20260812 00:32:52.142516 29782 leader_election.cc:302] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80abe6351e03425dba89ce2fd8faff9e; no voters:
I20260812 00:32:52.143095 29782 leader_election.cc:288] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:52.143229 29796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:52.144093 29796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [term 1 LEADER]: Becoming Leader. State: Replica: 80abe6351e03425dba89ce2fd8faff9e, State: Running, Role: LEADER
I20260812 00:32:52.144673 29796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80abe6351e03425dba89ce2fd8faff9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42485 } }
I20260812 00:32:52.145444 29782 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:52.147913 29799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80abe6351e03425dba89ce2fd8faff9e. Latest consensus state: current_term: 1 leader_uuid: "80abe6351e03425dba89ce2fd8faff9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80abe6351e03425dba89ce2fd8faff9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42485 } } }
I20260812 00:32:52.148401 29799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:52.149286 29797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80abe6351e03425dba89ce2fd8faff9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80abe6351e03425dba89ce2fd8faff9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42485 } } }
I20260812 00:32:52.149734 29797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:52.153909 29806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:52.158286 29806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:52.166827 29806 catalog_manager.cc:1347] Generated new cluster ID: 1517d6e2957a4a2e8cb60c49f78bcb8d
I20260812 00:32:52.167003 29806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:52.188633 29806 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:52.190217 29806 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:52.202116 29806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80abe6351e03425dba89ce2fd8faff9e: Generated new TSK 0
I20260812 00:32:52.203008 29806 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:32:52.218983 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 29665
W20260812 00:32:52.220491 29774 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49537
W20260812 00:32:52.221451 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 29665: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:32:52.221674 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 29665
W20260812 00:32:52.251183 29643 connection.cc:535] client connection to 127.0.0.1:42485 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42485): Connection reset by peer (error 104)
2026-08-12T00:32:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2247 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:52 dist-test-slave-c12x krb5kdc[29821](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:52 dist-test-slave-c12x krb5kdc[29821](info): set up 2 sockets
Aug 12 00:32:52 dist-test-slave-c12x krb5kdc[29821](info): commencing operation
krb5kdc: starting...
W20260812 00:32:53.575845 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.002s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:32:53 dist-test-slave-c12x krb5kdc[29821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:32:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:32:53.899014 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40021
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:54.245119 29840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:54.245404 29840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:54.245589 29840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:54.252651 29840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:54.252759 29840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:54.252907 29840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:54.253027 29840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:54.253108 29840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:54.262902 29840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40021
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:54.264289 29840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:54.265659 29840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:54.277894 29847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:54.278117 29849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:54.278026 29851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:54.279054 29840 server_base.cc:1034] running on GCE node
I20260812 00:32:54.280028 29840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:54.281463 29840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:54.282677 29840 hybrid_clock.cc:648] HybridClock initialized: now 1786494774282641 us; error 25 us; skew 500 ppm
I20260812 00:32:54.282999 29840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:54 dist-test-slave-c12x krb5kdc[29821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494774, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:54.286193 29840 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:32:54.287762 29840 webserver.cc:460] Webserver started at http://127.0.0.1:34929/ using document root <none> and password file <none>
I20260812 00:32:54.288443 29840 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:54.288563 29840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:54.288832 29840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:54.292052 29840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "6de6e8eb9edb4e6294b95cc330bad959"
format_stamp: "Formatted at 2026-08-12 00:32:54 on dist-test-slave-c12x"
server_key: "5764d90a7556b0e4386360742d87fc7e"
server_key_iv: "40000748dee857e22dcd4fe6d012d60d"
server_key_version: "encryptionkey@0"
I20260812 00:32:54.292805 29840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "6de6e8eb9edb4e6294b95cc330bad959"
format_stamp: "Formatted at 2026-08-12 00:32:54 on dist-test-slave-c12x"
server_key: "5764d90a7556b0e4386360742d87fc7e"
server_key_iv: "40000748dee857e22dcd4fe6d012d60d"
server_key_version: "encryptionkey@0"
I20260812 00:32:54.298729 29840 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 00:32:54.302421 29862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:54.303858 29840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:32:54.304004 29840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "6de6e8eb9edb4e6294b95cc330bad959"
format_stamp: "Formatted at 2026-08-12 00:32:54 on dist-test-slave-c12x"
server_key: "5764d90a7556b0e4386360742d87fc7e"
server_key_iv: "40000748dee857e22dcd4fe6d012d60d"
server_key_version: "encryptionkey@0"
I20260812 00:32:54.304175 29840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:54.309801 29840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:54.314144 29840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:54.314393 29840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:54.333113 29840 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40021
I20260812 00:32:54.333164 29947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40021 every 8 connection(s)
I20260812 00:32:54.334592 29840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:54.338451 29949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:54.340453 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 29840
I20260812 00:32:54.340680 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:54.341154 30458 external_mini_cluster.cc:1428] Setting key 7d4ef3205f7c9ace12494a5e07add654
I20260812 00:32:54.349058 29952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:54.342962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53863 (local address 127.0.0.1:40021)
0812 00:32:54.343833 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:54.343849 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:54.343892 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:32:54.345595 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:54.345619 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:54.345950 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:54.346258 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:54.347395 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:54.347401 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:54.347417 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:54.347501 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:54.347572 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:54.347596 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:54.347771 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:54.347880 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 00:32:54.348108 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":427,"threads_started":1}
I20260812 00:32:54.350765 29949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959: Bootstrap starting.
I20260812 00:32:54.353062 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:32:54.354090 29949 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:54.355109 29949 log.cc:824] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:54.358085 29949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959: No bootstrap required, opened a new log
I20260812 00:32:54.360615 29952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:54.357777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33823 (local address 127.0.0.1:40021)
0812 00:32:54.357968 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:54.357975 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:54.358388 (+ 413us) server_negotiation.cc:407] Connection header received
0812 00:32:54.358529 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:54.358539 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:54.358612 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:54.358732 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:54.359870 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:54.359875 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:54.359880 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:54.359898 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:54.359949 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:54.359975 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:54.360112 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:54.360239 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 00:32:54.360308 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:32:54.367250 29949 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6e8eb9edb4e6294b95cc330bad959" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40021 } }
I20260812 00:32:54.367695 29949 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:54.367785 29949 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de6e8eb9edb4e6294b95cc330bad959, State: Initialized, Role: FOLLOWER
I20260812 00:32:54.368304 29949 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6e8eb9edb4e6294b95cc330bad959" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40021 } }
I20260812 00:32:54.368507 29949 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:54.368618 29949 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:54.368753 29949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:54.371237 29949 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6e8eb9edb4e6294b95cc330bad959" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40021 } }
I20260812 00:32:54.371929 29949 leader_election.cc:302] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6de6e8eb9edb4e6294b95cc330bad959; no voters:
I20260812 00:32:54.372529 29949 leader_election.cc:288] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:54.372738 29959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:54.373682 29959 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [term 1 LEADER]: Becoming Leader. State: Replica: 6de6e8eb9edb4e6294b95cc330bad959, State: Running, Role: LEADER
I20260812 00:32:54.374300 29959 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6e8eb9edb4e6294b95cc330bad959" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40021 } }
I20260812 00:32:54.374934 29949 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:54.377696 29961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6de6e8eb9edb4e6294b95cc330bad959. Latest consensus state: current_term: 1 leader_uuid: "6de6e8eb9edb4e6294b95cc330bad959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6e8eb9edb4e6294b95cc330bad959" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40021 } } }
I20260812 00:32:54.378142 29961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:54.378556 29960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6de6e8eb9edb4e6294b95cc330bad959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6e8eb9edb4e6294b95cc330bad959" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40021 } } }
I20260812 00:32:54.379506 29960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:54.380312 29969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:54.386780 29969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:54.396719 29969 catalog_manager.cc:1347] Generated new cluster ID: 984dee36545449af9aa777e50d8c28b3
I20260812 00:32:54.396843 29969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:54.424862 29969 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:54.425416 29969 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:54.436797 29969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6de6e8eb9edb4e6294b95cc330bad959: Generated new TSK 0
I20260812 00:32:54.437776 29969 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:32:54.442209 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 29840
W20260812 00:32:54.443470 29940 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53863
W20260812 00:32:54.444214 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 29840: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:32:54.444382 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 29840
2026-08-12T00:32:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2220 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:54 dist-test-slave-c12x krb5kdc[29986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:54 dist-test-slave-c12x krb5kdc[29986](info): set up 2 sockets
Aug 12 00:32:54 dist-test-slave-c12x krb5kdc[29986](info): commencing operation
krb5kdc: starting...
W20260812 00:32:55.862241 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.370s user 0.006s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:32:56 dist-test-slave-c12x krb5kdc[29986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:32:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:32:56.190991 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44005
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:56.555459 30001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:56.555816 30001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:56.555998 30001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:56.563684 30001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:56.563807 30001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:56.563937 30001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:56.564045 30001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:56.564126 30001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:56.574620 30001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:56.576109 30001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:56.577457 30001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:56.589912 30022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:56.589991 30016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:56.589946 30019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:56.590766 30001 server_base.cc:1034] running on GCE node
I20260812 00:32:56.591653 30001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:56.593034 30001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:56.594245 30001 hybrid_clock.cc:648] HybridClock initialized: now 1786494776594184 us; error 49 us; skew 500 ppm
I20260812 00:32:56.594615 30001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:56 dist-test-slave-c12x krb5kdc[29986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494776, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:56.597833 30001 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:32:56.599385 30001 webserver.cc:460] Webserver started at http://127.0.0.1:33371/ using document root <none> and password file <none>
I20260812 00:32:56.600121 30001 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:56.600256 30001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:56.600582 30001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:56.603611 30001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "8640d6263ba64eecab358ace24628eeb"
format_stamp: "Formatted at 2026-08-12 00:32:56 on dist-test-slave-c12x"
server_key: "afcc0dcddf82cabafdad392fe46b1fd8"
server_key_iv: "fa764a9e463321c94371df6ebe4abc40"
server_key_version: "encryptionkey@0"
I20260812 00:32:56.604398 30001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "8640d6263ba64eecab358ace24628eeb"
format_stamp: "Formatted at 2026-08-12 00:32:56 on dist-test-slave-c12x"
server_key: "afcc0dcddf82cabafdad392fe46b1fd8"
server_key_iv: "fa764a9e463321c94371df6ebe4abc40"
server_key_version: "encryptionkey@0"
I20260812 00:32:56.609424 30001 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:32:56.612789 30034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:56.614122 30001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:32:56.614267 30001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "8640d6263ba64eecab358ace24628eeb"
format_stamp: "Formatted at 2026-08-12 00:32:56 on dist-test-slave-c12x"
server_key: "afcc0dcddf82cabafdad392fe46b1fd8"
server_key_iv: "fa764a9e463321c94371df6ebe4abc40"
server_key_version: "encryptionkey@0"
I20260812 00:32:56.614429 30001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:56.643955 30001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:56.648877 30001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:56.649230 30001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:56.670531 30001 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44005
I20260812 00:32:56.670565 30125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44005 every 8 connection(s)
I20260812 00:32:56.672116 30001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:56.674657 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30001
I20260812 00:32:56.674891 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:56.675422 30458 external_mini_cluster.cc:1428] Setting key 85e627e7f5a8e090d7871305ce4135f2
I20260812 00:32:56.676420 30126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:56.690114 30126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb: Bootstrap starting.
Aug 12 00:32:56 dist-test-slave-c12x krb5kdc[29986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:32:56.693823 30126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:56.694947 30126 log.cc:824] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:56.697921 30126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb: No bootstrap required, opened a new log
I20260812 00:32:56.699728 30130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:56.677413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58205 (local address 127.0.0.1:44005)
0812 00:32:56.678374 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:56.678393 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:56.678723 (+ 330us) server_negotiation.cc:407] Connection header received
0812 00:32:56.681385 (+ 2662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:56.681407 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:56.681845 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:56.682264 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:56.684101 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:56.685372 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:56.686705 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:56.687493 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:56.687722 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:56.692238 (+ 4516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:56.692250 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:56.692265 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:56.692306 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:56.695619 (+ 3313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:56.696360 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:56.696368 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:56.696375 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:56.696545 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:56.696941 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:56.696947 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:56.696950 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:56.697488 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:56.697806 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:56.698270 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 00:32:56.698715 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":415,"threads_started":1}
I20260812 00:32:56.703500 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:32:56.706326 30126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8640d6263ba64eecab358ace24628eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44005 } }
I20260812 00:32:56.706845 30126 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:56.706971 30126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8640d6263ba64eecab358ace24628eeb, State: Initialized, Role: FOLLOWER
I20260812 00:32:56.707674 30126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8640d6263ba64eecab358ace24628eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44005 } }
I20260812 00:32:56.708257 30126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:56.708464 30126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:56.708669 30126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:56.711007 30126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8640d6263ba64eecab358ace24628eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44005 } }
I20260812 00:32:56.711658 30126 leader_election.cc:302] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8640d6263ba64eecab358ace24628eeb; no voters:
I20260812 00:32:56.712293 30126 leader_election.cc:288] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:56.712463 30141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:56.713806 30141 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [term 1 LEADER]: Becoming Leader. State: Replica: 8640d6263ba64eecab358ace24628eeb, State: Running, Role: LEADER
I20260812 00:32:56.714488 30141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8640d6263ba64eecab358ace24628eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44005 } }
I20260812 00:32:56.714746 30126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:56.717370 30142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8640d6263ba64eecab358ace24628eeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8640d6263ba64eecab358ace24628eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44005 } } }
I20260812 00:32:56.717765 30142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:56.720571 30144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8640d6263ba64eecab358ace24628eeb. Latest consensus state: current_term: 1 leader_uuid: "8640d6263ba64eecab358ace24628eeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8640d6263ba64eecab358ace24628eeb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44005 } } }
I20260812 00:32:56.720966 30144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:56.725301 30149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:56.728070 30130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:56.708170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56085 (local address 127.0.0.1:44005)
0812 00:32:56.708328 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:56.708332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:56.708909 (+ 577us) server_negotiation.cc:407] Connection header received
0812 00:32:56.709137 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:56.709142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:56.709218 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:56.709336 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:56.710775 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:56.711629 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:56.713755 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:56.714465 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:56.714572 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:56.718562 (+ 3990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:56.718569 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:56.718574 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:32:56.718621 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:56.723623 (+ 5002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:56.724839 (+ 1216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:56.724848 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:56.724853 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:56.725132 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:32:56.725675 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:32:56.725682 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:32:56.725686 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:32:56.726179 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:56.726430 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:56.727187 (+ 757us) server_negotiation.cc:299] Negotiation successful
0812 00:32:56.727537 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 00:32:56.731909 30149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:56.740795 30149 catalog_manager.cc:1347] Generated new cluster ID: ea714ffdd01644068043543a25190a39
I20260812 00:32:56.740938 30149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:56.753711 30149 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:56.755184 30149 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:56.767267 30149 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8640d6263ba64eecab358ace24628eeb: Generated new TSK 0
I20260812 00:32:56.768208 30149 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:32:56.781507 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30001
I20260812 00:32:56.782799 30117 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:32:56.878392 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30001
2026-08-12T00:32:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2432 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:57 dist-test-slave-c12x krb5kdc[30173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:57 dist-test-slave-c12x krb5kdc[30173](info): set up 2 sockets
Aug 12 00:32:57 dist-test-slave-c12x krb5kdc[30173](info): commencing operation
krb5kdc: starting...
W20260812 00:32:58.216421 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:32:58 dist-test-slave-c12x krb5kdc[30173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:32:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:32:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:32:58.546308 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36675
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:32:58.924299 30188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:32:58.924624 30188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:32:58.924719 30188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:32:58.932123 30188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:32:58.932243 30188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:32:58.932315 30188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:32:58.932422 30188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:32:58.932495 30188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:32:58.943017 30188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:32:58.944401 30188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:32:58.945724 30188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:32:58.958279 30198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:58.958305 30194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:32:58.958499 30196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:32:58.959560 30188 server_base.cc:1034] running on GCE node
I20260812 00:32:58.960513 30188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:32:58.962132 30188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:32:58.963356 30188 hybrid_clock.cc:648] HybridClock initialized: now 1786494778963304 us; error 43 us; skew 500 ppm
I20260812 00:32:58.963811 30188 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:32:58 dist-test-slave-c12x krb5kdc[30173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494778, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:32:58.967198 30188 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:32:58.968912 30188 webserver.cc:460] Webserver started at http://127.0.0.1:43507/ using document root <none> and password file <none>
I20260812 00:32:58.969671 30188 fs_manager.cc:359] Metadata directory not provided
I20260812 00:32:58.969827 30188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:32:58.970180 30188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:32:58.973575 30188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "aecaf48f9ee840e587f0cd3eb1148cc5"
format_stamp: "Formatted at 2026-08-12 00:32:58 on dist-test-slave-c12x"
server_key: "73c04ed1953105679a819acfd0176c91"
server_key_iv: "478cb6bbd60e2bc9278b8c9ea899e762"
server_key_version: "encryptionkey@0"
I20260812 00:32:58.974399 30188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "aecaf48f9ee840e587f0cd3eb1148cc5"
format_stamp: "Formatted at 2026-08-12 00:32:58 on dist-test-slave-c12x"
server_key: "73c04ed1953105679a819acfd0176c91"
server_key_iv: "478cb6bbd60e2bc9278b8c9ea899e762"
server_key_version: "encryptionkey@0"
I20260812 00:32:58.979979 30188 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260812 00:32:58.983875 30209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:32:58.985519 30188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:32:58.985767 30188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "aecaf48f9ee840e587f0cd3eb1148cc5"
format_stamp: "Formatted at 2026-08-12 00:32:58 on dist-test-slave-c12x"
server_key: "73c04ed1953105679a819acfd0176c91"
server_key_iv: "478cb6bbd60e2bc9278b8c9ea899e762"
server_key_version: "encryptionkey@0"
I20260812 00:32:58.986002 30188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:32:59.029318 30188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:32:59.034119 30188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:32:59.034459 30188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:32:59.054585 30188 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36675
I20260812 00:32:59.054620 30296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36675 every 8 connection(s)
I20260812 00:32:59.056131 30188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:32:59.060142 30298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:32:59.065148 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30188
I20260812 00:32:59.065332 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:32:59.065814 30458 external_mini_cluster.cc:1428] Setting key 59ea64fbbf1b2f4db0abb0e5fa3d46bb
I20260812 00:32:59.073048 30298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5: Bootstrap starting.
I20260812 00:32:59.076989 30298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5: Neither blocks nor log segments found. Creating new log.
I20260812 00:32:59.078313 30298 log.cc:824] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:32:59.081562 30301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:59.067799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55477 (local address 127.0.0.1:36675)
0812 00:32:59.068730 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:59.068746 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:59.068799 (+ 53us) server_negotiation.cc:407] Connection header received
0812 00:32:59.071363 (+ 2564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:59.071393 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:59.071985 (+ 592us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:59.072430 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:59.072961 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:59.074999 (+ 2038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:59.076385 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:59.077525 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:59.077721 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:59.078844 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:59.078856 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:59.078878 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:59.079610 (+ 732us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:59.079686 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:59.079711 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:59.079857 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:59.080041 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 00:32:59.080304 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":381,"threads_started":1}
I20260812 00:32:59.081784 30298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5: No bootstrap required, opened a new log
I20260812 00:32:59.085475 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:32:59.090713 30298 raft_consensus.cc:348] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aecaf48f9ee840e587f0cd3eb1148cc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36675 } }
I20260812 00:32:59.091368 30298 raft_consensus.cc:374] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:32:59.091519 30298 raft_consensus.cc:729] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aecaf48f9ee840e587f0cd3eb1148cc5, State: Initialized, Role: FOLLOWER
I20260812 00:32:59.092253 30298 consensus_queue.cc:260] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aecaf48f9ee840e587f0cd3eb1148cc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36675 } }
I20260812 00:32:59.092563 30298 raft_consensus.cc:388] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:32:59.092708 30298 raft_consensus.cc:482] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:32:59.092900 30298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:32:59.095809 30298 raft_consensus.cc:504] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aecaf48f9ee840e587f0cd3eb1148cc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36675 } }
I20260812 00:32:59.096504 30298 leader_election.cc:302] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aecaf48f9ee840e587f0cd3eb1148cc5; no voters:
I20260812 00:32:59.097038 30301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:32:59.090013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59117 (local address 127.0.0.1:36675)
0812 00:32:59.090178 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 00:32:59.090182 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:32:59.090772 (+ 590us) server_negotiation.cc:407] Connection header received
0812 00:32:59.090989 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:32:59.090996 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:32:59.091078 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:32:59.091199 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:32:59.091869 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:59.092984 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:59.094269 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:32:59.094991 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:32:59.095116 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:32:59.096251 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:32:59.096256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:32:59.096260 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:32:59.096281 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:32:59.096348 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:32:59.096369 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:32:59.096463 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 00:32:59.096583 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 00:32:59.096678 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:32:59.097265 30298 leader_election.cc:288] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:32:59.097431 30309 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:32:59.099789 30298 sys_catalog.cc:564] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:32:59.099751 30309 raft_consensus.cc:686] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [term 1 LEADER]: Becoming Leader. State: Replica: aecaf48f9ee840e587f0cd3eb1148cc5, State: Running, Role: LEADER
I20260812 00:32:59.100282 30309 consensus_queue.cc:237] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aecaf48f9ee840e587f0cd3eb1148cc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36675 } }
I20260812 00:32:59.103127 30310 sys_catalog.cc:455] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aecaf48f9ee840e587f0cd3eb1148cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aecaf48f9ee840e587f0cd3eb1148cc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36675 } } }
I20260812 00:32:59.103605 30310 sys_catalog.cc:458] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:59.103713 30312 sys_catalog.cc:455] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aecaf48f9ee840e587f0cd3eb1148cc5. Latest consensus state: current_term: 1 leader_uuid: "aecaf48f9ee840e587f0cd3eb1148cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aecaf48f9ee840e587f0cd3eb1148cc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36675 } } }
I20260812 00:32:59.104024 30312 sys_catalog.cc:458] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:32:59.106523 30319 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:32:59.113255 30319 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:32:59.122500 30319 catalog_manager.cc:1347] Generated new cluster ID: f2fc98cc3be646d5bb341bbdbdf5515a
I20260812 00:32:59.122628 30319 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:32:59.131944 30319 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:32:59.133240 30319 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:32:59.140575 30319 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aecaf48f9ee840e587f0cd3eb1148cc5: Generated new TSK 0
I20260812 00:32:59.141420 30319 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:32:59.152894 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30188
W20260812 00:32:59.154102 30291 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55477
W20260812 00:32:59.154924 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30188: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:32:59.155092 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30188
2026-08-12T00:32:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2275 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:32:59 dist-test-slave-c12x krb5kdc[30334](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:32:59 dist-test-slave-c12x krb5kdc[30334](info): set up 2 sockets
Aug 12 00:32:59 dist-test-slave-c12x krb5kdc[30334](info): commencing operation
krb5kdc: starting...
W20260812 00:33:00.498574 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.006s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:00 dist-test-slave-c12x krb5kdc[30334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:33:00.824805 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39073
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:01.190621 30352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:01.190950 30352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:01.191140 30352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:01.199493 30352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:01.199618 30352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:01.199728 30352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:01.199824 30352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:01.199899 30352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:01.210144 30352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:01.211601 30352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:01.213008 30352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:01.225656 30363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:01.225838 30365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:01.225659 30362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:01.227216 30352 server_base.cc:1034] running on GCE node
I20260812 00:33:01.228158 30352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:01.229769 30352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:01.231029 30352 hybrid_clock.cc:648] HybridClock initialized: now 1786494781231034 us; error 107 us; skew 500 ppm
I20260812 00:33:01.231420 30352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:01 dist-test-slave-c12x krb5kdc[30334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494781, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:01.234813 30352 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:33:01.236653 30352 webserver.cc:460] Webserver started at http://127.0.0.1:44297/ using document root <none> and password file <none>
I20260812 00:33:01.237504 30352 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:01.237669 30352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:01.238024 30352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:01.241463 30352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "ce742f6507bb44419a45ee6bba59b36d"
format_stamp: "Formatted at 2026-08-12 00:33:01 on dist-test-slave-c12x"
server_key: "ee3d79664f01091eb1391308c5b8303a"
server_key_iv: "ae4b58a81857e06368f71c548cc64ce5"
server_key_version: "encryptionkey@0"
I20260812 00:33:01.242283 30352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "ce742f6507bb44419a45ee6bba59b36d"
format_stamp: "Formatted at 2026-08-12 00:33:01 on dist-test-slave-c12x"
server_key: "ee3d79664f01091eb1391308c5b8303a"
server_key_iv: "ae4b58a81857e06368f71c548cc64ce5"
server_key_version: "encryptionkey@0"
I20260812 00:33:01.247968 30352 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260812 00:33:01.251881 30376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:01.253300 30352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:33:01.253530 30352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "ce742f6507bb44419a45ee6bba59b36d"
format_stamp: "Formatted at 2026-08-12 00:33:01 on dist-test-slave-c12x"
server_key: "ee3d79664f01091eb1391308c5b8303a"
server_key_iv: "ae4b58a81857e06368f71c548cc64ce5"
server_key_version: "encryptionkey@0"
I20260812 00:33:01.253762 30352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:01.260197 30352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:01.264591 30352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:01.264921 30352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:01.284876 30352 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39073
I20260812 00:33:01.284915 30470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39073 every 8 connection(s)
I20260812 00:33:01.286386 30352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:01.289686 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30352
I20260812 00:33:01.289888 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:01.290426 30458 external_mini_cluster.cc:1428] Setting key c417534c652b23349b133922ef921a10
I20260812 00:33:01.290868 30473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:01.299259 30477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:01.292456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33377 (local address 127.0.0.1:39073)
0812 00:33:01.293307 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:01.293319 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:01.293361 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:33:01.295672 (+ 2311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:01.295698 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:01.296071 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:01.296432 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:01.297611 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:01.297618 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:01.297631 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:01.297647 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:01.297727 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:01.297748 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:01.297939 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:01.298061 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 00:33:01.298298 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":450,"threads_started":1}
I20260812 00:33:01.303488 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:01.305076 30473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d: Bootstrap starting.
I20260812 00:33:01.308521 30473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:01.309810 30473 log.cc:824] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:01.311003 30477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:01.308103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39207 (local address 127.0.0.1:39073)
0812 00:33:01.308332 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:01.308342 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:01.308887 (+ 545us) server_negotiation.cc:407] Connection header received
0812 00:33:01.309038 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:01.309045 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:01.309123 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:01.309236 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:01.310194 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:01.310199 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:01.310204 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:01.310222 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:01.310274 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:01.310300 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:01.310460 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:01.310617 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 00:33:01.310665 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:33:01.313048 30473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d: No bootstrap required, opened a new log
I20260812 00:33:01.320868 30473 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce742f6507bb44419a45ee6bba59b36d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39073 } }
I20260812 00:33:01.321286 30473 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:01.321404 30473 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce742f6507bb44419a45ee6bba59b36d, State: Initialized, Role: FOLLOWER
I20260812 00:33:01.322054 30473 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce742f6507bb44419a45ee6bba59b36d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39073 } }
I20260812 00:33:01.322290 30473 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:01.322444 30473 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:01.322628 30473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:01.324920 30473 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce742f6507bb44419a45ee6bba59b36d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39073 } }
I20260812 00:33:01.325466 30473 leader_election.cc:302] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce742f6507bb44419a45ee6bba59b36d; no voters:
I20260812 00:33:01.326138 30473 leader_election.cc:288] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:01.326323 30486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:01.327327 30486 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [term 1 LEADER]: Becoming Leader. State: Replica: ce742f6507bb44419a45ee6bba59b36d, State: Running, Role: LEADER
I20260812 00:33:01.327910 30486 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce742f6507bb44419a45ee6bba59b36d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39073 } }
I20260812 00:33:01.328403 30473 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:01.331378 30487 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce742f6507bb44419a45ee6bba59b36d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce742f6507bb44419a45ee6bba59b36d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39073 } } }
I20260812 00:33:01.331555 30488 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce742f6507bb44419a45ee6bba59b36d. Latest consensus state: current_term: 1 leader_uuid: "ce742f6507bb44419a45ee6bba59b36d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce742f6507bb44419a45ee6bba59b36d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39073 } } }
I20260812 00:33:01.331921 30487 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:01.331969 30488 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:01.334333 30495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:01.340139 30495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:01.349602 30495 catalog_manager.cc:1347] Generated new cluster ID: 53993dd19f4b4a16932742ad00c22a4b
I20260812 00:33:01.349736 30495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:01.368110 30495 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:01.368551 30495 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:01.378639 30495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce742f6507bb44419a45ee6bba59b36d: Generated new TSK 0
I20260812 00:33:01.379383 30495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:01.388545 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30352
W20260812 00:33:01.389686 30456 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33377
W20260812 00:33:01.390386 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30352: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:01.390544 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30352
2026-08-12T00:33:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2237 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:01 dist-test-slave-c12x krb5kdc[30516](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:01 dist-test-slave-c12x krb5kdc[30516](info): set up 2 sockets
Aug 12 00:33:01 dist-test-slave-c12x krb5kdc[30516](info): commencing operation
krb5kdc: starting...
W20260812 00:33:02.724819 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:02 dist-test-slave-c12x krb5kdc[30516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:33:03.055837 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33329
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:03.411763 30537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:03.412060 30537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:03.412227 30537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:03.419535 30537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:03.419653 30537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:03.419760 30537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:03.419864 30537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:03.419938 30537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:03.429850 30537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:03.431176 30537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:03.432580 30537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:03.444712 30543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:03.444772 30544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:03.444679 30547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:03.446151 30537 server_base.cc:1034] running on GCE node
I20260812 00:33:03.446954 30537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:03.448504 30537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:03.449707 30537 hybrid_clock.cc:648] HybridClock initialized: now 1786494783449662 us; error 34 us; skew 500 ppm
I20260812 00:33:03.450070 30537 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:03 dist-test-slave-c12x krb5kdc[30516](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494783, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:03.453362 30537 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:33:03.454936 30537 webserver.cc:460] Webserver started at http://127.0.0.1:46335/ using document root <none> and password file <none>
I20260812 00:33:03.455709 30537 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:03.455842 30537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:03.456182 30537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:03.459262 30537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "eb52bd5421304997a4a473636a48ac5f"
format_stamp: "Formatted at 2026-08-12 00:33:03 on dist-test-slave-c12x"
server_key: "181241f9b4c7d61e4f320c61e3f11f9f"
server_key_iv: "27c310fd87ea59fb71eece25055a0b3e"
server_key_version: "encryptionkey@0"
I20260812 00:33:03.460132 30537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "eb52bd5421304997a4a473636a48ac5f"
format_stamp: "Formatted at 2026-08-12 00:33:03 on dist-test-slave-c12x"
server_key: "181241f9b4c7d61e4f320c61e3f11f9f"
server_key_iv: "27c310fd87ea59fb71eece25055a0b3e"
server_key_version: "encryptionkey@0"
I20260812 00:33:03.465389 30537 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 00:33:03.469069 30557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:03.470397 30537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:33:03.470590 30537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "eb52bd5421304997a4a473636a48ac5f"
format_stamp: "Formatted at 2026-08-12 00:33:03 on dist-test-slave-c12x"
server_key: "181241f9b4c7d61e4f320c61e3f11f9f"
server_key_iv: "27c310fd87ea59fb71eece25055a0b3e"
server_key_version: "encryptionkey@0"
I20260812 00:33:03.470798 30537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:03.489530 30537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:03.494413 30537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:03.494760 30537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:03.514557 30537 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33329
I20260812 00:33:03.514611 30632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33329 every 8 connection(s)
I20260812 00:33:03.516072 30537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:03.519872 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30537
I20260812 00:33:03.519980 30633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:03.520107 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:03.520568 30458 external_mini_cluster.cc:1428] Setting key 32386bd39eedfc346518264bc9db35b5
I20260812 00:33:03.535089 30633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f: Bootstrap starting.
Aug 12 00:33:03 dist-test-slave-c12x krb5kdc[30516](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:33:03.539403 30633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:03.540902 30633 log.cc:824] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:03.544571 30633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f: No bootstrap required, opened a new log
I20260812 00:33:03.545881 30639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:03.522404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:37975 (local address 127.0.0.1:33329)
0812 00:33:03.523247 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:03.523264 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:03.523317 (+ 53us) server_negotiation.cc:407] Connection header received
0812 00:33:03.525173 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:03.525204 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:03.525744 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:03.526185 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:03.527529 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:03.529633 (+ 2104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:03.530923 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:03.532083 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:03.532288 (+ 205us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:03.536522 (+ 4234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:03.536534 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:03.536555 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:03.536607 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:03.540818 (+ 4211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:03.541874 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:03.541881 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:03.541891 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:03.542077 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:03.542626 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:03.542631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:03.542634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:03.543311 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:03.543676 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:03.544108 (+ 432us) server_negotiation.cc:299] Negotiation successful
0812 00:33:03.544461 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":311,"threads_started":1}
I20260812 00:33:03.550034 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:03.553604 30633 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb52bd5421304997a4a473636a48ac5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33329 } }
I20260812 00:33:03.553992 30633 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:03.554105 30633 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb52bd5421304997a4a473636a48ac5f, State: Initialized, Role: FOLLOWER
I20260812 00:33:03.554903 30633 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb52bd5421304997a4a473636a48ac5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33329 } }
I20260812 00:33:03.555209 30633 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:03.555378 30633 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:03.555611 30633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:03.558450 30633 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb52bd5421304997a4a473636a48ac5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33329 } }
I20260812 00:33:03.558990 30633 leader_election.cc:302] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb52bd5421304997a4a473636a48ac5f; no voters:
I20260812 00:33:03.559659 30633 leader_election.cc:288] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:03.559782 30652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:03.561069 30652 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [term 1 LEADER]: Becoming Leader. State: Replica: eb52bd5421304997a4a473636a48ac5f, State: Running, Role: LEADER
I20260812 00:33:03.561790 30652 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb52bd5421304997a4a473636a48ac5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33329 } }
I20260812 00:33:03.562213 30633 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:03.564983 30653 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb52bd5421304997a4a473636a48ac5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb52bd5421304997a4a473636a48ac5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33329 } } }
I20260812 00:33:03.565388 30653 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:03.565193 30654 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb52bd5421304997a4a473636a48ac5f. Latest consensus state: current_term: 1 leader_uuid: "eb52bd5421304997a4a473636a48ac5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb52bd5421304997a4a473636a48ac5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33329 } } }
I20260812 00:33:03.565598 30654 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:03.569404 30663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:03.572548 30639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:03.554543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:35153 (local address 127.0.0.1:33329)
0812 00:33:03.554741 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:03.554749 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:03.555104 (+ 355us) server_negotiation.cc:407] Connection header received
0812 00:33:03.555308 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:03.555314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:03.555412 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:03.555565 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:03.556947 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:03.558119 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:03.559675 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:03.560469 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:03.560608 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:03.563858 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:03.563865 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:03.563869 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:03.563915 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:03.568015 (+ 4100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:03.569216 (+ 1201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:03.569222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:03.569225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:03.569371 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:03.569985 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:03.569990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:03.569993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:03.570513 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:03.570837 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:03.571737 (+ 900us) server_negotiation.cc:299] Negotiation successful
0812 00:33:03.571997 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:33:03.576521 30663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:03.586362 30663 catalog_manager.cc:1347] Generated new cluster ID: c77f17f05ee7427a9d39f2d6a7ec0633
I20260812 00:33:03.586509 30663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:03.596962 30663 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:03.598966 30663 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:03.613005 30663 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb52bd5421304997a4a473636a48ac5f: Generated new TSK 0
I20260812 00:33:03.613919 30663 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:03.626039 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30537
I20260812 00:33:03.627580 30625 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:03.719211 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30537
W20260812 00:33:03.746606 30511 connection.cc:535] client connection to 127.0.0.1:33329 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33329): Connection reset by peer (error 104)
2026-08-12T00:33:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2328 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:03 dist-test-slave-c12x krb5kdc[30682](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:03 dist-test-slave-c12x krb5kdc[30682](info): set up 2 sockets
Aug 12 00:33:03 dist-test-slave-c12x krb5kdc[30682](info): commencing operation
krb5kdc: starting...
W20260812 00:33:05.073971 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:05 dist-test-slave-c12x krb5kdc[30682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:33:05.405247 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:05.763572 30700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:05.763926 30700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:05.764091 30700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:05.771518 30700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:05.771723 30700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:05.771922 30700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:05.772054 30700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:05.772135 30700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:05.782403 30700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:05.783878 30700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:05.785250 30700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:05.798218 30708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:05.798182 30709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:05.798242 30711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:05.799223 30700 server_base.cc:1034] running on GCE node
I20260812 00:33:05.800213 30700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:05.801744 30700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:05.802994 30700 hybrid_clock.cc:648] HybridClock initialized: now 1786494785802947 us; error 49 us; skew 500 ppm
I20260812 00:33:05.803365 30700 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:05 dist-test-slave-c12x krb5kdc[30682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494785, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:05.806716 30700 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:33:05.808386 30700 webserver.cc:460] Webserver started at http://127.0.0.1:35741/ using document root <none> and password file <none>
I20260812 00:33:05.809124 30700 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:05.809273 30700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:05.809605 30700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:05.812769 30700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "0bd55ff0bba94537a132664169cc4742"
format_stamp: "Formatted at 2026-08-12 00:33:05 on dist-test-slave-c12x"
server_key: "fb8cc4e9fbd296b8ad94e1d8c808f9f6"
server_key_iv: "5e14573e746de247a60d46aaf5463095"
server_key_version: "encryptionkey@0"
I20260812 00:33:05.813601 30700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "0bd55ff0bba94537a132664169cc4742"
format_stamp: "Formatted at 2026-08-12 00:33:05 on dist-test-slave-c12x"
server_key: "fb8cc4e9fbd296b8ad94e1d8c808f9f6"
server_key_iv: "5e14573e746de247a60d46aaf5463095"
server_key_version: "encryptionkey@0"
I20260812 00:33:05.819068 30700 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 00:33:05.822645 30718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:05.824066 30700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:33:05.824258 30700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "0bd55ff0bba94537a132664169cc4742"
format_stamp: "Formatted at 2026-08-12 00:33:05 on dist-test-slave-c12x"
server_key: "fb8cc4e9fbd296b8ad94e1d8c808f9f6"
server_key_iv: "5e14573e746de247a60d46aaf5463095"
server_key_version: "encryptionkey@0"
I20260812 00:33:05.824469 30700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:05.835844 30700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:05.840562 30700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:05.840903 30700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:05.861398 30700 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36431
I20260812 00:33:05.861423 30790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36431 every 8 connection(s)
I20260812 00:33:05.863373 30700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:05.867340 30792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:05.868566 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30700
I20260812 00:33:05.868767 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:05.869351 30458 external_mini_cluster.cc:1428] Setting key d1a6eec3d1f8bc9287becbf2e222d3dc
I20260812 00:33:05.881714 30792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742: Bootstrap starting.
I20260812 00:33:05.883028 30798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:05.871202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:44261 (local address 127.0.0.1:36431)
0812 00:33:05.872076 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:05.872090 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:05.872134 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:33:05.873810 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:05.873835 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:05.874265 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:05.874614 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:05.875242 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:05.876614 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:05.878572 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:05.879317 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:05.879513 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:05.880812 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:05.880819 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:05.880834 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:05.881363 (+ 529us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:05.881441 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:05.881465 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:05.881598 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:05.881914 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 00:33:05.882065 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":436,"threads_started":1}
I20260812 00:33:05.885109 30792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:05.886366 30792 log.cc:824] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:05.887015 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:05.889314 30792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742: No bootstrap required, opened a new log
I20260812 00:33:05.899794 30792 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bd55ff0bba94537a132664169cc4742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36431 } }
I20260812 00:33:05.900235 30792 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:05.900357 30792 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd55ff0bba94537a132664169cc4742, State: Initialized, Role: FOLLOWER
I20260812 00:33:05.901093 30798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:05.891815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:52039 (local address 127.0.0.1:36431)
0812 00:33:05.892050 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:05.892056 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:05.892391 (+ 335us) server_negotiation.cc:407] Connection header received
0812 00:33:05.892564 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:05.892567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:05.892653 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:05.892739 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:05.893359 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:05.894511 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:05.896625 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:05.897935 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:05.898109 (+ 174us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:05.899781 (+ 1672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:05.899788 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:05.899795 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:05.899823 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:05.899899 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:05.899924 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:05.900045 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:05.900648 (+ 603us) server_negotiation.cc:299] Negotiation successful
0812 00:33:05.900713 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 00:33:05.901073 30792 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bd55ff0bba94537a132664169cc4742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36431 } }
I20260812 00:33:05.901531 30792 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:05.901717 30792 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:05.901932 30792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:05.905743 30792 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bd55ff0bba94537a132664169cc4742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36431 } }
I20260812 00:33:05.906350 30792 leader_election.cc:302] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bd55ff0bba94537a132664169cc4742; no voters:
I20260812 00:33:05.907148 30792 leader_election.cc:288] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:05.907307 30812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:05.908190 30812 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [term 1 LEADER]: Becoming Leader. State: Replica: 0bd55ff0bba94537a132664169cc4742, State: Running, Role: LEADER
I20260812 00:33:05.908874 30812 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bd55ff0bba94537a132664169cc4742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36431 } }
I20260812 00:33:05.909734 30792 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:05.912384 30815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bd55ff0bba94537a132664169cc4742. Latest consensus state: current_term: 1 leader_uuid: "0bd55ff0bba94537a132664169cc4742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bd55ff0bba94537a132664169cc4742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36431 } } }
I20260812 00:33:05.912357 30814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bd55ff0bba94537a132664169cc4742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bd55ff0bba94537a132664169cc4742" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36431 } } }
I20260812 00:33:05.912904 30815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:05.912914 30814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:05.917820 30819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:05.923204 30819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:05.933696 30819 catalog_manager.cc:1347] Generated new cluster ID: e2db47876cf0435da41f5cf4caa89e93
I20260812 00:33:05.933827 30819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:05.950304 30819 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:05.951792 30819 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:05.961021 30819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bd55ff0bba94537a132664169cc4742: Generated new TSK 0
I20260812 00:33:05.961905 30819 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:05.971180 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30700
W20260812 00:33:05.972575 30786 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.121:44261
W20260812 00:33:05.973426 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30700: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:05.973585 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30700
W20260812 00:33:06.004395 30680 connection.cc:535] client connection to 127.0.0.1:36431 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36431): Connection reset by peer (error 104)
2026-08-12T00:33:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2257 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:06 dist-test-slave-c12x krb5kdc[30841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:06 dist-test-slave-c12x krb5kdc[30841](info): set up 2 sockets
Aug 12 00:33:06 dist-test-slave-c12x krb5kdc[30841](info): commencing operation
krb5kdc: starting...
W20260812 00:33:07.324724 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.001s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:07 dist-test-slave-c12x krb5kdc[30841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:33:07.650290 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43171
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:08.007027 30859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:08.007316 30859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:08.007419 30859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:08.014585 30859 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:08.014693 30859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:08.014739 30859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:08.014801 30859 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:08.014846 30859 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:08.024660 30859 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:08.025902 30859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:08.027177 30859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:08.039229 30864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:08.039165 30867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:08.039197 30865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:08.040148 30859 server_base.cc:1034] running on GCE node
I20260812 00:33:08.040959 30859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:08.042425 30859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:08.043664 30859 hybrid_clock.cc:648] HybridClock initialized: now 1786494788043604 us; error 52 us; skew 500 ppm
I20260812 00:33:08.044044 30859 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:08 dist-test-slave-c12x krb5kdc[30841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494788, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:08.047286 30859 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:33:08.048854 30859 webserver.cc:460] Webserver started at http://127.0.0.1:35151/ using document root <none> and password file <none>
I20260812 00:33:08.049594 30859 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:08.049700 30859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:08.049981 30859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:08.053543 30859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "af277f3090234e0ebf794ecf922808a0"
format_stamp: "Formatted at 2026-08-12 00:33:08 on dist-test-slave-c12x"
server_key: "c9fe052708247dece1b7b5023e20cba9"
server_key_iv: "d8f54a075dd930849886af5f3ac0a62d"
server_key_version: "encryptionkey@0"
I20260812 00:33:08.054382 30859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "af277f3090234e0ebf794ecf922808a0"
format_stamp: "Formatted at 2026-08-12 00:33:08 on dist-test-slave-c12x"
server_key: "c9fe052708247dece1b7b5023e20cba9"
server_key_iv: "d8f54a075dd930849886af5f3ac0a62d"
server_key_version: "encryptionkey@0"
I20260812 00:33:08.060170 30859 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 00:33:08.064090 30876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:08.065675 30859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:33:08.065886 30859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "af277f3090234e0ebf794ecf922808a0"
format_stamp: "Formatted at 2026-08-12 00:33:08 on dist-test-slave-c12x"
server_key: "c9fe052708247dece1b7b5023e20cba9"
server_key_iv: "d8f54a075dd930849886af5f3ac0a62d"
server_key_version: "encryptionkey@0"
I20260812 00:33:08.066116 30859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:08.072400 30859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:08.076546 30859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:08.076854 30859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:08.097002 30859 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43171
I20260812 00:33:08.097052 30949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43171 every 8 connection(s)
I20260812 00:33:08.098526 30859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:08.102511 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 30859
I20260812 00:33:08.102722 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:08.102898 30950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:08.103292 30458 external_mini_cluster.cc:1428] Setting key e3d42f0d220e57c6cb9d9f28140ae183
I20260812 00:33:08.111346 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:08.105258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:58725 (local address 127.0.0.1:43171)
0812 00:33:08.106172 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:08.106187 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:08.106229 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:33:08.107972 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:08.107997 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:08.108345 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:08.108708 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:08.109826 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:08.109833 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:08.109849 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:08.109867 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:08.109929 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:08.109952 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:08.110133 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:08.110246 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 00:33:08.110396 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":434,"threads_started":1}
I20260812 00:33:08.115041 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:08.117066 30950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0: Bootstrap starting.
I20260812 00:33:08.120872 30950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:08.122121 30950 log.cc:824] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:08.122334 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:08.119655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:39085 (local address 127.0.0.1:43171)
0812 00:33:08.119856 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:08.119865 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:08.120250 (+ 385us) server_negotiation.cc:407] Connection header received
0812 00:33:08.120447 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:08.120456 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:08.120508 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:08.120618 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:08.121566 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:08.121571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:08.121576 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:08.121616 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:08.121657 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:08.121671 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:08.121788 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:08.121908 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 00:33:08.121978 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 00:33:08.125252 30950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0: No bootstrap required, opened a new log
I20260812 00:33:08.133080 30950 raft_consensus.cc:348] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af277f3090234e0ebf794ecf922808a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43171 } }
I20260812 00:33:08.133539 30950 raft_consensus.cc:374] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:08.133656 30950 raft_consensus.cc:729] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af277f3090234e0ebf794ecf922808a0, State: Initialized, Role: FOLLOWER
I20260812 00:33:08.134241 30950 consensus_queue.cc:260] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af277f3090234e0ebf794ecf922808a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43171 } }
I20260812 00:33:08.134495 30950 raft_consensus.cc:388] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:08.134649 30950 raft_consensus.cc:482] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:08.134856 30950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:08.137303 30950 raft_consensus.cc:504] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af277f3090234e0ebf794ecf922808a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43171 } }
I20260812 00:33:08.137871 30950 leader_election.cc:302] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af277f3090234e0ebf794ecf922808a0; no voters:
I20260812 00:33:08.138450 30950 leader_election.cc:288] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:08.138598 30963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:08.139560 30963 raft_consensus.cc:686] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [term 1 LEADER]: Becoming Leader. State: Replica: af277f3090234e0ebf794ecf922808a0, State: Running, Role: LEADER
I20260812 00:33:08.140275 30963 consensus_queue.cc:237] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af277f3090234e0ebf794ecf922808a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43171 } }
I20260812 00:33:08.141428 30950 sys_catalog.cc:564] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:08.143250 30964 sys_catalog.cc:455] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af277f3090234e0ebf794ecf922808a0. Latest consensus state: current_term: 1 leader_uuid: "af277f3090234e0ebf794ecf922808a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af277f3090234e0ebf794ecf922808a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43171 } } }
I20260812 00:33:08.143741 30964 sys_catalog.cc:458] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:08.144619 30965 sys_catalog.cc:455] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af277f3090234e0ebf794ecf922808a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af277f3090234e0ebf794ecf922808a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43171 } } }
I20260812 00:33:08.145118 30965 sys_catalog.cc:458] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:08.146936 30976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:08.152612 30976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:08.162580 30976 catalog_manager.cc:1347] Generated new cluster ID: ff04a61e44274076bc8e761d2953ff42
I20260812 00:33:08.162725 30976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:08.173038 30976 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:08.173568 30976 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:08.181030 30976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af277f3090234e0ebf794ecf922808a0: Generated new TSK 0
I20260812 00:33:08.182128 30976 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:08.192350 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30859
W20260812 00:33:08.193675 30944 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.121:58725
W20260812 00:33:08.194454 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 30859: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:08.194598 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 30859
2026-08-12T00:33:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2216 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:08 dist-test-slave-c12x krb5kdc[30998](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:08 dist-test-slave-c12x krb5kdc[30998](info): set up 2 sockets
Aug 12 00:33:08 dist-test-slave-c12x krb5kdc[30998](info): commencing operation
krb5kdc: starting...
W20260812 00:33:09.547734 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.011s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:09 dist-test-slave-c12x krb5kdc[30998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:33:09.876327 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33705
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:10.237022 31017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:10.237340 31017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:10.237435 31017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:10.244952 31017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:10.245079 31017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:10.245128 31017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:10.245191 31017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:10.245235 31017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:10.255622 31017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33705
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:10.257339 31017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:10.259099 31017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:10.272667 31023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:10.272756 31025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:10.272720 31028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:10.273957 31017 server_base.cc:1034] running on GCE node
I20260812 00:33:10.274868 31017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:10.276615 31017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:10.277850 31017 hybrid_clock.cc:648] HybridClock initialized: now 1786494790277798 us; error 41 us; skew 500 ppm
I20260812 00:33:10.278251 31017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:10 dist-test-slave-c12x krb5kdc[30998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494790, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:10.286520 31017 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:33:10.288219 31017 webserver.cc:460] Webserver started at http://127.0.0.1:37375/ using document root <none> and password file <none>
I20260812 00:33:10.288923 31017 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:10.289033 31017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:10.289388 31017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:10.292609 31017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "8cbbe782db7a4a24a342b1b2445ef6f3"
format_stamp: "Formatted at 2026-08-12 00:33:10 on dist-test-slave-c12x"
server_key: "750981ef7f0758906d45b5bb3675c716"
server_key_iv: "d520e00de6346ea648c62ef039b66fe5"
server_key_version: "encryptionkey@0"
I20260812 00:33:10.293401 31017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "8cbbe782db7a4a24a342b1b2445ef6f3"
format_stamp: "Formatted at 2026-08-12 00:33:10 on dist-test-slave-c12x"
server_key: "750981ef7f0758906d45b5bb3675c716"
server_key_iv: "d520e00de6346ea648c62ef039b66fe5"
server_key_version: "encryptionkey@0"
I20260812 00:33:10.298686 31017 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260812 00:33:10.302376 31040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:10.303848 31017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:33:10.304044 31017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "8cbbe782db7a4a24a342b1b2445ef6f3"
format_stamp: "Formatted at 2026-08-12 00:33:10 on dist-test-slave-c12x"
server_key: "750981ef7f0758906d45b5bb3675c716"
server_key_iv: "d520e00de6346ea648c62ef039b66fe5"
server_key_version: "encryptionkey@0"
I20260812 00:33:10.304250 31017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:10.333443 31017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:10.338099 31017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:10.338480 31017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:10.362399 31017 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33705
I20260812 00:33:10.362422 31118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33705 every 8 connection(s)
I20260812 00:33:10.364317 31017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:10.368556 31119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:10.373704 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31017
I20260812 00:33:10.373924 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:10.374486 30458 external_mini_cluster.cc:1428] Setting key 5f23abc5552d72ba476f9f911c5fed3c
I20260812 00:33:10.380712 31119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3: Bootstrap starting.
I20260812 00:33:10.384708 31119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:10.385998 31119 log.cc:824] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:10.389891 31119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3: No bootstrap required, opened a new log
Aug 12 00:33:10 dist-test-slave-c12x krb5kdc[30998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 00:33:10.401067 31125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:10.376399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:59151 (local address 127.0.0.1:33705)
0812 00:33:10.377250 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:10.377265 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:10.377309 (+ 44us) server_negotiation.cc:407] Connection header received
0812 00:33:10.379102 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:10.379130 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:10.379629 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:10.379976 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:10.381962 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:10.383373 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:10.385252 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:10.386031 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:10.386237 (+ 206us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:10.391329 (+ 5092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:10.391342 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:10.391364 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:10.391422 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:10.395687 (+ 4265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:10.396625 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:10.396635 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:10.396646 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:10.396905 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:10.397358 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:10.397364 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:10.397369 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:10.398183 (+ 814us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:10.398515 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:10.399051 (+ 536us) server_negotiation.cc:299] Negotiation successful
0812 00:33:10.399512 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":385,"threads_started":1}
I20260812 00:33:10.401412 31119 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbbe782db7a4a24a342b1b2445ef6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33705 } }
I20260812 00:33:10.401903 31119 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:10.402025 31119 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cbbe782db7a4a24a342b1b2445ef6f3, State: Initialized, Role: FOLLOWER
I20260812 00:33:10.402693 31119 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbbe782db7a4a24a342b1b2445ef6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33705 } }
I20260812 00:33:10.402980 31119 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:10.403136 31119 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:10.403335 31119 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:10.405920 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:10.406147 31119 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbbe782db7a4a24a342b1b2445ef6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33705 } }
I20260812 00:33:10.406742 31119 leader_election.cc:302] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cbbe782db7a4a24a342b1b2445ef6f3; no voters:
I20260812 00:33:10.407506 31119 leader_election.cc:288] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:10.407660 31129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:10.412106 31129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [term 1 LEADER]: Becoming Leader. State: Replica: 8cbbe782db7a4a24a342b1b2445ef6f3, State: Running, Role: LEADER
I20260812 00:33:10.412829 31129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbbe782db7a4a24a342b1b2445ef6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33705 } }
I20260812 00:33:10.414973 31119 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:10.416239 31130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cbbe782db7a4a24a342b1b2445ef6f3. Latest consensus state: current_term: 1 leader_uuid: "8cbbe782db7a4a24a342b1b2445ef6f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbbe782db7a4a24a342b1b2445ef6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33705 } } }
I20260812 00:33:10.416788 31130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:10.417474 31131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cbbe782db7a4a24a342b1b2445ef6f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbbe782db7a4a24a342b1b2445ef6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33705 } } }
I20260812 00:33:10.417781 31131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:10.429702 31144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:10.435562 31144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:10.446132 31125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:10.415357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:56451 (local address 127.0.0.1:33705)
0812 00:33:10.420674 (+ 5317us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:10.420685 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:10.424225 (+ 3540us) server_negotiation.cc:407] Connection header received
0812 00:33:10.425368 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:10.425376 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:10.425525 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:10.425673 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:10.428528 (+ 2855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:10.430206 (+ 1678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:10.432328 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:10.433070 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:10.433242 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:10.437975 (+ 4733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:10.437986 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:10.437991 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:10.438042 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:10.442179 (+ 4137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:10.443303 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:10.443311 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:10.443317 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:10.443623 (+ 306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:10.444278 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:10.444283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:10.444286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:10.444733 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:10.445027 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:10.445551 (+ 524us) server_negotiation.cc:299] Negotiation successful
0812 00:33:10.445762 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5121}
I20260812 00:33:10.446381 31144 catalog_manager.cc:1347] Generated new cluster ID: cd29c442dffb42db8e052bb06edc2f1b
I20260812 00:33:10.446542 31144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:10.462131 31144 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:10.463529 31144 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:10.475203 31144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cbbe782db7a4a24a342b1b2445ef6f3: Generated new TSK 0
I20260812 00:33:10.476130 31144 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:10.483908 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31017
I20260812 00:33:10.485435 31110 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:10.577704 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31017
W20260812 00:33:10.606655 30995 connection.cc:535] client connection to 127.0.0.1:33705 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33705): Connection reset by peer (error 104)
2026-08-12T00:33:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2385 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:10 dist-test-slave-c12x krb5kdc[31166](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:10 dist-test-slave-c12x krb5kdc[31166](info): set up 2 sockets
Aug 12 00:33:10 dist-test-slave-c12x krb5kdc[31166](info): commencing operation
krb5kdc: starting...
W20260812 00:33:11.929405 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.002s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:12 dist-test-slave-c12x krb5kdc[31166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:33:12.278882 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44943
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:12.646328 31185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:12.646729 31185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:12.646899 31185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:12.654510 31185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:12.654697 31185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:12.654829 31185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:12.654939 31185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:12.655030 31185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:12.665472 31185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44943
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:12.667052 31185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:12.668501 31185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:12.681208 31193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:12.681210 31190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:12.681236 31191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:12.682222 31185 server_base.cc:1034] running on GCE node
I20260812 00:33:12.683238 31185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:12.684978 31185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:12.686254 31185 hybrid_clock.cc:648] HybridClock initialized: now 1786494792686222 us; error 50 us; skew 500 ppm
I20260812 00:33:12.686671 31185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:12 dist-test-slave-c12x krb5kdc[31166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494792, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:12.690160 31185 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:33:12.691898 31185 webserver.cc:460] Webserver started at http://127.0.0.1:42985/ using document root <none> and password file <none>
I20260812 00:33:12.692631 31185 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:12.692785 31185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:12.693130 31185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:12.696357 31185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "002fce19627e405d9bdf2ad8d14461c3"
format_stamp: "Formatted at 2026-08-12 00:33:12 on dist-test-slave-c12x"
server_key: "088000f763fca11a818fe2779e6db108"
server_key_iv: "a8c6adb748e8bb5451c69e05c5c82172"
server_key_version: "encryptionkey@0"
I20260812 00:33:12.697187 31185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "002fce19627e405d9bdf2ad8d14461c3"
format_stamp: "Formatted at 2026-08-12 00:33:12 on dist-test-slave-c12x"
server_key: "088000f763fca11a818fe2779e6db108"
server_key_iv: "a8c6adb748e8bb5451c69e05c5c82172"
server_key_version: "encryptionkey@0"
I20260812 00:33:12.702535 31185 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:33:12.706131 31203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:12.707603 31185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 00:33:12.707809 31185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "002fce19627e405d9bdf2ad8d14461c3"
format_stamp: "Formatted at 2026-08-12 00:33:12 on dist-test-slave-c12x"
server_key: "088000f763fca11a818fe2779e6db108"
server_key_iv: "a8c6adb748e8bb5451c69e05c5c82172"
server_key_version: "encryptionkey@0"
I20260812 00:33:12.708050 31185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:12.725246 31185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:12.729928 31185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:12.730244 31185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:12.750566 31185 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44943
I20260812 00:33:12.750608 31282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44943 every 8 connection(s)
I20260812 00:33:12.752161 31185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:12.753630 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31185
I20260812 00:33:12.753839 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:12.754400 30458 external_mini_cluster.cc:1428] Setting key 22aa2add49d68b30aba5c85db4479b22
I20260812 00:33:12.756925 31283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:12.768169 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:12.756279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:39185 (local address 127.0.0.1:44943)
0812 00:33:12.757119 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:12.757131 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:12.757172 (+ 41us) server_negotiation.cc:407] Connection header received
0812 00:33:12.758818 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:12.758840 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:12.759232 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:12.759630 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:12.760290 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:12.761637 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:12.763549 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:12.764225 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:12.764353 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:12.765703 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:12.765711 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:12.765723 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:12.766272 (+ 549us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:12.766356 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:12.766386 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:12.766517 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:12.766851 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 00:33:12.767061 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":360,"threads_started":1}
I20260812 00:33:12.769748 31283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3: Bootstrap starting.
I20260812 00:33:12.772091 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:12.773180 31283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:12.774405 31283 log.cc:824] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:12.777275 31283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3: No bootstrap required, opened a new log
I20260812 00:33:12.784529 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:12.777637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:59533 (local address 127.0.0.1:44943)
0812 00:33:12.777879 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:12.777888 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:12.778297 (+ 409us) server_negotiation.cc:407] Connection header received
0812 00:33:12.778483 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:12.778486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:12.778552 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:12.778632 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:12.779254 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:12.780112 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:12.781967 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:12.782407 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:12.782500 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:12.783703 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:12.783708 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:12.783711 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:12.783730 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:12.783785 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:12.783807 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:12.783897 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:12.784122 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 00:33:12.784168 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:33:12.787621 31283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002fce19627e405d9bdf2ad8d14461c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260812 00:33:12.788053 31283 raft_consensus.cc:374] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:12.788166 31283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 002fce19627e405d9bdf2ad8d14461c3, State: Initialized, Role: FOLLOWER
I20260812 00:33:12.788801 31283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002fce19627e405d9bdf2ad8d14461c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260812 00:33:12.789067 31283 raft_consensus.cc:388] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:12.789242 31283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:12.789424 31283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:12.792203 31283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002fce19627e405d9bdf2ad8d14461c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260812 00:33:12.792675 31283 leader_election.cc:302] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 002fce19627e405d9bdf2ad8d14461c3; no voters:
I20260812 00:33:12.793272 31283 leader_election.cc:288] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:12.793438 31297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:12.794313 31297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [term 1 LEADER]: Becoming Leader. State: Replica: 002fce19627e405d9bdf2ad8d14461c3, State: Running, Role: LEADER
I20260812 00:33:12.794966 31297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002fce19627e405d9bdf2ad8d14461c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260812 00:33:12.795708 31283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:12.797969 31302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 002fce19627e405d9bdf2ad8d14461c3. Latest consensus state: current_term: 1 leader_uuid: "002fce19627e405d9bdf2ad8d14461c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002fce19627e405d9bdf2ad8d14461c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } } }
I20260812 00:33:12.798427 31302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:12.798632 31300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "002fce19627e405d9bdf2ad8d14461c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002fce19627e405d9bdf2ad8d14461c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } } }
I20260812 00:33:12.799007 31300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:12.800959 31311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:12.806377 31311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:12.816447 31311 catalog_manager.cc:1347] Generated new cluster ID: f140e39e0e5e4661826cc2cb34fc5e4f
I20260812 00:33:12.816633 31311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:12.833436 31311 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:12.835047 31311 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:12.850613 31311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 002fce19627e405d9bdf2ad8d14461c3: Generated new TSK 0
I20260812 00:33:12.851584 31311 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:12.864440 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31185
W20260812 00:33:12.866384 31277 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.121:39185
W20260812 00:33:12.867148 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31185: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:12.867328 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31185
W20260812 00:33:12.894462 31164 connection.cc:535] client connection to 127.0.0.1:44943 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44943): Connection reset by peer (error 104)
2026-08-12T00:33:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2287 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:12 dist-test-slave-c12x krb5kdc[31332](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:12 dist-test-slave-c12x krb5kdc[31332](info): set up 2 sockets
Aug 12 00:33:12 dist-test-slave-c12x krb5kdc[31332](info): commencing operation
krb5kdc: starting...
W20260812 00:33:14.207106 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:14 dist-test-slave-c12x krb5kdc[31332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 00:33:14.539113 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46247
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:14.912359 31351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:14.912693 31351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:14.912921 31351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:14.920689 31351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:14.920831 31351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:14.920996 31351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:14.921100 31351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:14.921195 31351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:14.931772 31351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46247
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:14.933243 31351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:14.934815 31351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:14.948215 31359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:14.948321 31360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:14.948347 31363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:14.949976 31351 server_base.cc:1034] running on GCE node
I20260812 00:33:14.950796 31351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:14.952378 31351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:14.953608 31351 hybrid_clock.cc:648] HybridClock initialized: now 1786494794953479 us; error 124 us; skew 500 ppm
I20260812 00:33:14.953999 31351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:14 dist-test-slave-c12x krb5kdc[31332](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494794, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:14.957464 31351 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 00:33:14.959209 31351 webserver.cc:460] Webserver started at http://127.0.0.1:34905/ using document root <none> and password file <none>
I20260812 00:33:14.960011 31351 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:14.960175 31351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:14.960510 31351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:14.963824 31351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101"
format_stamp: "Formatted at 2026-08-12 00:33:14 on dist-test-slave-c12x"
server_key: "4130a2957733cc0f4b4ab8ce167a2626"
server_key_iv: "f7cab7c00e70d3c164864a516daf2a8d"
server_key_version: "encryptionkey@0"
I20260812 00:33:14.964687 31351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101"
format_stamp: "Formatted at 2026-08-12 00:33:14 on dist-test-slave-c12x"
server_key: "4130a2957733cc0f4b4ab8ce167a2626"
server_key_iv: "f7cab7c00e70d3c164864a516daf2a8d"
server_key_version: "encryptionkey@0"
I20260812 00:33:14.970302 31351 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 00:33:14.974175 31372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:14.975883 31351 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 00:33:14.976107 31351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101"
format_stamp: "Formatted at 2026-08-12 00:33:14 on dist-test-slave-c12x"
server_key: "4130a2957733cc0f4b4ab8ce167a2626"
server_key_iv: "f7cab7c00e70d3c164864a516daf2a8d"
server_key_version: "encryptionkey@0"
I20260812 00:33:14.976356 31351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:14.983139 31351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:14.988231 31351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:14.988576 31351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:15.008962 31351 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46247
I20260812 00:33:15.009019 31440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46247 every 8 connection(s)
I20260812 00:33:15.010478 31351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:15.013602 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31351
I20260812 00:33:15.013803 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:15.014274 30458 external_mini_cluster.cc:1428] Setting key 6b1a88bf5d19e625616092e43c500c0c
I20260812 00:33:15.014818 31442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:15.023979 31445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:15.016274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:54565 (local address 127.0.0.1:46247)
0812 00:33:15.017127 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:15.017143 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:15.017195 (+ 52us) server_negotiation.cc:407] Connection header received
0812 00:33:15.019900 (+ 2705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:15.019932 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:15.020410 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:15.020886 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:15.021920 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:15.021929 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:15.021955 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:15.021977 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:15.022050 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:15.022089 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:15.022332 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:15.022462 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 00:33:15.022684 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":345,"threads_started":1}
I20260812 00:33:15.027853 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:15.030153 31442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101: Bootstrap starting.
I20260812 00:33:15.034684 31442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:15.036093 31442 log.cc:824] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:15.036273 31445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:15.033576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.121:33983 (local address 127.0.0.1:46247)
0812 00:33:15.033770 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:15.033777 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:15.034116 (+ 339us) server_negotiation.cc:407] Connection header received
0812 00:33:15.034271 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:15.034279 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:15.034349 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:15.034477 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:15.035490 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:15.035496 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:15.035502 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:15.035522 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:15.035573 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:15.035596 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:15.035735 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:15.035896 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 00:33:15.035970 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:33:15.039113 31442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101: No bootstrap required, opened a new log
I20260812 00:33:15.047741 31442 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } }
I20260812 00:33:15.048177 31442 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:15.048257 31442 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f189e7a9d5d4fe6bcdd90657c2f5101, State: Initialized, Role: FOLLOWER
I20260812 00:33:15.048799 31442 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } }
I20260812 00:33:15.049057 31442 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:15.049259 31442 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:15.049459 31442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:15.051819 31442 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } }
I20260812 00:33:15.052351 31442 leader_election.cc:302] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f189e7a9d5d4fe6bcdd90657c2f5101; no voters:
I20260812 00:33:15.052991 31442 leader_election.cc:288] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:15.053177 31458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:15.053905 31458 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [term 1 LEADER]: Becoming Leader. State: Replica: 5f189e7a9d5d4fe6bcdd90657c2f5101, State: Running, Role: LEADER
I20260812 00:33:15.054508 31458 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } }
I20260812 00:33:15.055284 31442 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:15.057365 31459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } } }
I20260812 00:33:15.058444 31459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:15.058005 31460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f189e7a9d5d4fe6bcdd90657c2f5101. Latest consensus state: current_term: 1 leader_uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f189e7a9d5d4fe6bcdd90657c2f5101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46247 } } }
I20260812 00:33:15.059173 31460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:15.064270 31464 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:15.070721 31464 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:15.080816 31464 catalog_manager.cc:1347] Generated new cluster ID: 1192ad66c58547a091f4c8bbac819f04
I20260812 00:33:15.080929 31464 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:15.096040 31464 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:15.096561 31464 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:15.108718 31464 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f189e7a9d5d4fe6bcdd90657c2f5101: Generated new TSK 0
I20260812 00:33:15.109637 31464 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:15.118866 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31351
W20260812 00:33:15.120771 31435 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.121:54565
W20260812 00:33:15.121666 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31351: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:15.121829 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31351
2026-08-12T00:33:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2258 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:15 dist-test-slave-c12x krb5kdc[31487](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:15 dist-test-slave-c12x krb5kdc[31487](info): set up 2 sockets
Aug 12 00:33:15 dist-test-slave-c12x krb5kdc[31487](info): commencing operation
krb5kdc: starting...
W20260812 00:33:16.493300 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.001s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:16 dist-test-slave-c12x krb5kdc[31487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:33:16.831357 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:45333
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:36135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:45333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:17.190737 31506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:17.191079 31506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:17.191264 31506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:17.199016 31506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:17.199148 31506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:17.199270 31506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:17.199362 31506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:17.199435 31506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:17.210093 31506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:36135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:45333
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:45333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:17.211563 31506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:17.212956 31506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:17.225984 31517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:17.226110 31516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:17.226158 31519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:17.226922 31506 server_base.cc:1034] running on GCE node
I20260812 00:33:17.227843 31506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:17.229372 31506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:17.230623 31506 hybrid_clock.cc:648] HybridClock initialized: now 1786494797230567 us; error 51 us; skew 500 ppm
I20260812 00:33:17.231002 31506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:17 dist-test-slave-c12x krb5kdc[31487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494797, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:17.239727 31506 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:33:17.241422 31506 webserver.cc:460] Webserver started at http://127.29.190.190:38127/ using document root <none> and password file <none>
I20260812 00:33:17.242195 31506 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:17.242352 31506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:17.242678 31506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:17.245965 31506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "72996d8b6e9a4bd4a87b57bb128eeec4"
format_stamp: "Formatted at 2026-08-12 00:33:17 on dist-test-slave-c12x"
server_key: "6e1734e7d52f24e55b1bfdc962c80e4c"
server_key_iv: "fdb23cb7c4758ee4f2621a12b0f35059"
server_key_version: "encryptionkey@0"
I20260812 00:33:17.246788 31506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "72996d8b6e9a4bd4a87b57bb128eeec4"
format_stamp: "Formatted at 2026-08-12 00:33:17 on dist-test-slave-c12x"
server_key: "6e1734e7d52f24e55b1bfdc962c80e4c"
server_key_iv: "fdb23cb7c4758ee4f2621a12b0f35059"
server_key_version: "encryptionkey@0"
I20260812 00:33:17.252449 31506 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260812 00:33:17.256208 31529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:17.257616 31506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:33:17.257841 31506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "72996d8b6e9a4bd4a87b57bb128eeec4"
format_stamp: "Formatted at 2026-08-12 00:33:17 on dist-test-slave-c12x"
server_key: "6e1734e7d52f24e55b1bfdc962c80e4c"
server_key_iv: "fdb23cb7c4758ee4f2621a12b0f35059"
server_key_version: "encryptionkey@0"
I20260812 00:33:17.258080 31506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:17.278697 31506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:17.282792 31506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:17.283099 31506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:17.302594 31506 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:45333
I20260812 00:33:17.302618 31608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:45333 every 8 connection(s)
I20260812 00:33:17.304050 31506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:17.305673 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31506
I20260812 00:33:17.305913 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:17.306547 30458 external_mini_cluster.cc:1428] Setting key 443d1ecdff050ecf7131d7e348e22466
I20260812 00:33:17.309120 31610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 00:33:17 dist-test-slave-c12x krb5kdc[31487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:33:17.323757 31610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4: Bootstrap starting.
I20260812 00:33:17.328426 31610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:17.329646 31610 log.cc:824] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:17.332505 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:17.308518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33597 (local address 127.29.190.190:45333)
0812 00:33:17.309398 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:17.309411 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:17.309457 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:33:17.311093 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:17.311118 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:17.311573 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:17.311912 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:17.313852 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:17.315240 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:17.317268 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:17.317965 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:17.318095 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:17.323511 (+ 5416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:17.323523 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:17.323543 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:17.323597 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:17.327883 (+ 4286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:17.328662 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:17.328669 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:17.328675 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:17.328845 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:17.329362 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:17.329366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:17.329368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:17.329957 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:17.330317 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:17.330823 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 00:33:17.331177 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":410,"threads_started":1}
I20260812 00:33:17.333238 31610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4: No bootstrap required, opened a new log
I20260812 00:33:17.336629 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:17.341603 31610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72996d8b6e9a4bd4a87b57bb128eeec4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45333 } }
I20260812 00:33:17.342109 31610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:17.342242 31610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72996d8b6e9a4bd4a87b57bb128eeec4, State: Initialized, Role: FOLLOWER
I20260812 00:33:17.342864 31610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72996d8b6e9a4bd4a87b57bb128eeec4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45333 } }
I20260812 00:33:17.343151 31610 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:17.343310 31610 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:17.343536 31610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:17.345884 31610 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72996d8b6e9a4bd4a87b57bb128eeec4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45333 } }
I20260812 00:33:17.346465 31610 leader_election.cc:302] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72996d8b6e9a4bd4a87b57bb128eeec4; no voters:
I20260812 00:33:17.347160 31610 leader_election.cc:288] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:17.347258 31624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:17.349694 31624 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [term 1 LEADER]: Becoming Leader. State: Replica: 72996d8b6e9a4bd4a87b57bb128eeec4, State: Running, Role: LEADER
I20260812 00:33:17.349889 31610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:17.350374 31624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72996d8b6e9a4bd4a87b57bb128eeec4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45333 } }
I20260812 00:33:17.353806 31625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72996d8b6e9a4bd4a87b57bb128eeec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72996d8b6e9a4bd4a87b57bb128eeec4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45333 } } }
I20260812 00:33:17.354281 31625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:17.354873 31626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72996d8b6e9a4bd4a87b57bb128eeec4. Latest consensus state: current_term: 1 leader_uuid: "72996d8b6e9a4bd4a87b57bb128eeec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72996d8b6e9a4bd4a87b57bb128eeec4" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 45333 } } }
I20260812 00:33:17.355223 31626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:17.358552 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:17.341105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45791 (local address 127.29.190.190:45333)
0812 00:33:17.341341 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:17.341351 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:17.341735 (+ 384us) server_negotiation.cc:407] Connection header received
0812 00:33:17.341914 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:17.341918 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:17.341979 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:17.342104 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:17.343851 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:17.344663 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:17.345942 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:17.346471 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:17.346611 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:17.349540 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:17.349549 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:17.349556 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:17.349608 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:17.353359 (+ 3751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:17.354410 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:17.354415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:17.354419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:17.354634 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:17.355190 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:17.355195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:17.355199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:17.355641 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:17.356060 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:17.357727 (+ 1667us) server_negotiation.cc:299] Negotiation successful
0812 00:33:17.357976 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 00:33:17.364648 31630 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:17.369824 31630 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:17.378688 31630 catalog_manager.cc:1347] Generated new cluster ID: f6a2ef7d35a54ab1846de013558d2482
I20260812 00:33:17.378803 31630 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:17.401026 31630 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:17.403004 31630 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:17.410532 31630 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72996d8b6e9a4bd4a87b57bb128eeec4: Generated new TSK 0
I20260812 00:33:17.411616 31630 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:17.418184 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31506
I20260812 00:33:17.419510 31604 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:17.513942 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31506
W20260812 00:33:17.539132 31485 connection.cc:535] client connection to 127.29.190.190:45333 recv error: Network error: failed to read from TLS socket (remote: 127.29.190.190:45333): Connection reset by peer (error 104)
2026-08-12T00:33:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2385 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:17 dist-test-slave-c12x krb5kdc[31657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:17 dist-test-slave-c12x krb5kdc[31657](info): set up 2 sockets
Aug 12 00:33:17 dist-test-slave-c12x krb5kdc[31657](info): commencing operation
krb5kdc: starting...
W20260812 00:33:18.899909 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:19 dist-test-slave-c12x krb5kdc[31657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:33:19.233039 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:35919
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:41811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:35919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:19.586066 31672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:19.586385 31672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:19.586570 31672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:19.594169 31672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:19.594305 31672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:19.594429 31672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:19.594554 31672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:19.594621 31672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:19.604883 31672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:41811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:35919
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:35919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:19.606338 31672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:19.607757 31672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:19.622424 31681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:19.622452 31680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:19.622649 31684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:19.624567 31672 server_base.cc:1034] running on GCE node
I20260812 00:33:19.625533 31672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:19.627084 31672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:19.628309 31672 hybrid_clock.cc:648] HybridClock initialized: now 1786494799628259 us; error 33 us; skew 500 ppm
I20260812 00:33:19.628669 31672 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:19 dist-test-slave-c12x krb5kdc[31657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494799, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:19.632243 31672 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:33:19.633965 31672 webserver.cc:460] Webserver started at http://127.29.190.190:33587/ using document root <none> and password file <none>
I20260812 00:33:19.634719 31672 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:19.634857 31672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:19.635205 31672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:19.638531 31672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "b61c3b1c295b4184a4acf696d79aa018"
format_stamp: "Formatted at 2026-08-12 00:33:19 on dist-test-slave-c12x"
server_key: "23404a16a7c4651f91adeda32b8534c2"
server_key_iv: "3d8749d9248e6a3587e28781ca36a068"
server_key_version: "encryptionkey@0"
I20260812 00:33:19.639343 31672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "b61c3b1c295b4184a4acf696d79aa018"
format_stamp: "Formatted at 2026-08-12 00:33:19 on dist-test-slave-c12x"
server_key: "23404a16a7c4651f91adeda32b8534c2"
server_key_iv: "3d8749d9248e6a3587e28781ca36a068"
server_key_version: "encryptionkey@0"
I20260812 00:33:19.644865 31672 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 00:33:19.648486 31695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:19.649974 31672 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:33:19.650195 31672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "b61c3b1c295b4184a4acf696d79aa018"
format_stamp: "Formatted at 2026-08-12 00:33:19 on dist-test-slave-c12x"
server_key: "23404a16a7c4651f91adeda32b8534c2"
server_key_iv: "3d8749d9248e6a3587e28781ca36a068"
server_key_version: "encryptionkey@0"
I20260812 00:33:19.650427 31672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:19.672865 31672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:19.677939 31672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:19.678298 31672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:19.700345 31672 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:35919
I20260812 00:33:19.700362 31768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:35919 every 8 connection(s)
I20260812 00:33:19.701959 31672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:19.706044 31769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:19.706669 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31672
I20260812 00:33:19.706859 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:19.707473 30458 external_mini_cluster.cc:1428] Setting key 096a603c8dee4f35bb87c78901af1ee8
I20260812 00:33:19.720711 31769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018: Bootstrap starting.
I20260812 00:33:19.722355 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:19.709430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52861 (local address 127.29.190.190:35919)
0812 00:33:19.710316 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:19.710328 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:19.710371 (+ 43us) server_negotiation.cc:407] Connection header received
0812 00:33:19.712596 (+ 2225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:19.712627 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:19.713099 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:19.713450 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:19.714133 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:19.715413 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:19.717511 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:19.718302 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:19.718443 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:19.719877 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:19.719885 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:19.719902 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:19.720478 (+ 576us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:19.720577 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:19.720606 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:19.720758 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:19.721152 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 00:33:19.721374 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":412,"threads_started":1}
I20260812 00:33:19.724195 31769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:19.725485 31769 log.cc:824] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:19.726516 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:19.728821 31769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018: No bootstrap required, opened a new log
I20260812 00:33:19.738765 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:19.731349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36719 (local address 127.29.190.190:35919)
0812 00:33:19.731601 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:19.731608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:19.731990 (+ 382us) server_negotiation.cc:407] Connection header received
0812 00:33:19.732156 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:19.732163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:19.732264 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:19.732413 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:19.732892 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:19.734132 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:19.735636 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:19.736400 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:19.736578 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:19.737822 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:19.737829 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:19.737835 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:19.737869 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:19.737938 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:19.737967 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:19.738134 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:19.738304 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 00:33:19.738382 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260812 00:33:19.739750 31769 raft_consensus.cc:348] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b61c3b1c295b4184a4acf696d79aa018" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35919 } }
I20260812 00:33:19.740341 31769 raft_consensus.cc:374] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:19.740500 31769 raft_consensus.cc:729] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c3b1c295b4184a4acf696d79aa018, State: Initialized, Role: FOLLOWER
I20260812 00:33:19.741200 31769 consensus_queue.cc:260] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b61c3b1c295b4184a4acf696d79aa018" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35919 } }
I20260812 00:33:19.741439 31769 raft_consensus.cc:388] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:19.741549 31769 raft_consensus.cc:482] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:19.741707 31769 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:19.744699 31769 raft_consensus.cc:504] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b61c3b1c295b4184a4acf696d79aa018" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35919 } }
I20260812 00:33:19.745249 31769 leader_election.cc:302] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b61c3b1c295b4184a4acf696d79aa018; no voters:
I20260812 00:33:19.745884 31769 leader_election.cc:288] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:19.746059 31787 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:19.747560 31787 raft_consensus.cc:686] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [term 1 LEADER]: Becoming Leader. State: Replica: b61c3b1c295b4184a4acf696d79aa018, State: Running, Role: LEADER
I20260812 00:33:19.748214 31787 consensus_queue.cc:237] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b61c3b1c295b4184a4acf696d79aa018" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35919 } }
I20260812 00:33:19.748596 31769 sys_catalog.cc:564] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:19.751210 31788 sys_catalog.cc:455] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b61c3b1c295b4184a4acf696d79aa018" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b61c3b1c295b4184a4acf696d79aa018" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35919 } } }
I20260812 00:33:19.751636 31788 sys_catalog.cc:458] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:19.751318 31789 sys_catalog.cc:455] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b61c3b1c295b4184a4acf696d79aa018. Latest consensus state: current_term: 1 leader_uuid: "b61c3b1c295b4184a4acf696d79aa018" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b61c3b1c295b4184a4acf696d79aa018" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35919 } } }
I20260812 00:33:19.751825 31789 sys_catalog.cc:458] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:19.760876 31800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:19.766006 31800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:19.775671 31800 catalog_manager.cc:1347] Generated new cluster ID: 4806ae6cd79049228b64561f68f229a1
I20260812 00:33:19.775804 31800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:19.806177 31800 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:19.807830 31800 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:19.815743 31800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b61c3b1c295b4184a4acf696d79aa018: Generated new TSK 0
I20260812 00:33:19.816701 31800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:19.833725 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31672
W20260812 00:33:19.835098 31762 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:52861
W20260812 00:33:19.836012 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31672: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:19.836186 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31672
W20260812 00:33:19.862423 31654 connection.cc:535] client connection to 127.29.190.190:35919 recv error: Network error: failed to read from TLS socket (remote: 127.29.190.190:35919): Connection reset by peer (error 104)
2026-08-12T00:33:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2322 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:19 dist-test-slave-c12x krb5kdc[31819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:19 dist-test-slave-c12x krb5kdc[31819](info): set up 2 sockets
Aug 12 00:33:19 dist-test-slave-c12x krb5kdc[31819](info): commencing operation
krb5kdc: starting...
W20260812 00:33:21.175240 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:21 dist-test-slave-c12x krb5kdc[31819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:33:21.506613 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:40995
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:40995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:21.878583 31840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:21.878898 31840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:21.878994 31840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:21.886631 31840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:21.886767 31840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:21.886816 31840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:21.886870 31840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:21.886917 31840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:21.897413 31840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:40995
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:40995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:21.898799 31840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:21.900326 31840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:21.913471 31845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:21.913503 31852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:21.913566 31846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:21.914624 31840 server_base.cc:1034] running on GCE node
I20260812 00:33:21.915635 31840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:21.917274 31840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:21.918536 31840 hybrid_clock.cc:648] HybridClock initialized: now 1786494801918498 us; error 49 us; skew 500 ppm
I20260812 00:33:21.918967 31840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:21 dist-test-slave-c12x krb5kdc[31819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494801, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:21.922443 31840 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:33:21.924722 31840 webserver.cc:460] Webserver started at http://127.29.190.190:42579/ using document root <none> and password file <none>
I20260812 00:33:21.925657 31840 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:21.925820 31840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:21.926270 31840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:21.929746 31840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "c753edb6875f42fbbb4c3c77b88b29ab"
format_stamp: "Formatted at 2026-08-12 00:33:21 on dist-test-slave-c12x"
server_key: "801fdc6dba2d55c79490b4ff0053e6f2"
server_key_iv: "07522920b2e2403a1ec078159ded2354"
server_key_version: "encryptionkey@0"
I20260812 00:33:21.930642 31840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "c753edb6875f42fbbb4c3c77b88b29ab"
format_stamp: "Formatted at 2026-08-12 00:33:21 on dist-test-slave-c12x"
server_key: "801fdc6dba2d55c79490b4ff0053e6f2"
server_key_iv: "07522920b2e2403a1ec078159ded2354"
server_key_version: "encryptionkey@0"
I20260812 00:33:21.936602 31840 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 00:33:21.940620 31860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:21.942199 31840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 00:33:21.942423 31840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "c753edb6875f42fbbb4c3c77b88b29ab"
format_stamp: "Formatted at 2026-08-12 00:33:21 on dist-test-slave-c12x"
server_key: "801fdc6dba2d55c79490b4ff0053e6f2"
server_key_iv: "07522920b2e2403a1ec078159ded2354"
server_key_version: "encryptionkey@0"
I20260812 00:33:21.942672 31840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:21.949077 31840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:21.953763 31840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:21.954107 31840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:21.974807 31840 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:40995
I20260812 00:33:21.974848 31933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:40995 every 8 connection(s)
I20260812 00:33:21.976346 31840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:21.980435 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 31840
I20260812 00:33:21.980523 31934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:21.980648 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:21.981232 30458 external_mini_cluster.cc:1428] Setting key aa35f64790077fedbeba9ed52a79ccd8
I20260812 00:33:21.989508 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:21.983090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39941 (local address 127.29.190.190:40995)
0812 00:33:21.984050 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:21.984062 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:21.984108 (+ 46us) server_negotiation.cc:407] Connection header received
0812 00:33:21.985716 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:21.985741 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:21.986095 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:21.986444 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:21.987808 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:21.987815 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:21.987829 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:21.987844 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:21.987924 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:21.987946 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:21.988140 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:21.988286 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 00:33:21.988509 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":481,"threads_started":1}
I20260812 00:33:21.993510 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:21.997269 31934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab: Bootstrap starting.
I20260812 00:33:22.002714 31934 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:22.002931 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:21.999715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47877 (local address 127.29.190.190:40995)
0812 00:33:21.999961 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:21.999975 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:22.000485 (+ 510us) server_negotiation.cc:407] Connection header received
0812 00:33:22.000701 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:22.000705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:22.000758 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:22.000836 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:22.002002 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:22.002007 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:22.002010 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:22.002024 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:22.002065 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:22.002081 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:22.002171 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:22.002353 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 00:33:22.002401 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 00:33:22.004328 31934 log.cc:824] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:22.007663 31934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab: No bootstrap required, opened a new log
I20260812 00:33:22.015547 31934 raft_consensus.cc:348] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c753edb6875f42fbbb4c3c77b88b29ab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40995 } }
I20260812 00:33:22.015969 31934 raft_consensus.cc:374] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:22.016083 31934 raft_consensus.cc:729] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c753edb6875f42fbbb4c3c77b88b29ab, State: Initialized, Role: FOLLOWER
I20260812 00:33:22.016676 31934 consensus_queue.cc:260] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c753edb6875f42fbbb4c3c77b88b29ab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40995 } }
I20260812 00:33:22.016944 31934 raft_consensus.cc:388] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:22.017095 31934 raft_consensus.cc:482] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:22.017269 31934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:22.019667 31934 raft_consensus.cc:504] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c753edb6875f42fbbb4c3c77b88b29ab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40995 } }
I20260812 00:33:22.020273 31934 leader_election.cc:302] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c753edb6875f42fbbb4c3c77b88b29ab; no voters:
I20260812 00:33:22.020913 31934 leader_election.cc:288] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:22.021068 31947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:22.021889 31947 raft_consensus.cc:686] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [term 1 LEADER]: Becoming Leader. State: Replica: c753edb6875f42fbbb4c3c77b88b29ab, State: Running, Role: LEADER
I20260812 00:33:22.022421 31947 consensus_queue.cc:237] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c753edb6875f42fbbb4c3c77b88b29ab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40995 } }
I20260812 00:33:22.023124 31934 sys_catalog.cc:564] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:22.025694 31952 sys_catalog.cc:455] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader c753edb6875f42fbbb4c3c77b88b29ab. Latest consensus state: current_term: 1 leader_uuid: "c753edb6875f42fbbb4c3c77b88b29ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c753edb6875f42fbbb4c3c77b88b29ab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40995 } } }
I20260812 00:33:22.025825 31949 sys_catalog.cc:455] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c753edb6875f42fbbb4c3c77b88b29ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c753edb6875f42fbbb4c3c77b88b29ab" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 40995 } } }
I20260812 00:33:22.026158 31952 sys_catalog.cc:458] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:22.026158 31949 sys_catalog.cc:458] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:22.027915 31960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:22.033514 31960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:22.043305 31960 catalog_manager.cc:1347] Generated new cluster ID: 044778e9045a427eb867146ea89d2400
I20260812 00:33:22.043427 31960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:22.061658 31960 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:22.062325 31960 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:22.069347 31960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c753edb6875f42fbbb4c3c77b88b29ab: Generated new TSK 0
I20260812 00:33:22.070230 31960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:22.080864 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31840
W20260812 00:33:22.082036 31926 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39941
W20260812 00:33:22.082867 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 31840: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:22.083034 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 31840
2026-08-12T00:33:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2248 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:22 dist-test-slave-c12x krb5kdc[31981](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:22 dist-test-slave-c12x krb5kdc[31981](info): set up 2 sockets
Aug 12 00:33:22 dist-test-slave-c12x krb5kdc[31981](info): commencing operation
krb5kdc: starting...
W20260812 00:33:23.426385 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.003s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:23 dist-test-slave-c12x krb5kdc[31981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:33:23.762909 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:41503
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:42497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:41503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:24.128544 32001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:24.128849 32001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:24.129061 32001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:24.136451 32001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:24.136569 32001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:24.136703 32001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:24.136831 32001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:24.136897 32001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:24.146870 32001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:42497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:41503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:41503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:24.148334 32001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:24.149765 32001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:24.162276 32007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:24.162308 32008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:24.162273 32010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:24.163255 32001 server_base.cc:1034] running on GCE node
I20260812 00:33:24.164202 32001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:24.165787 32001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:24.166997 32001 hybrid_clock.cc:648] HybridClock initialized: now 1786494804166945 us; error 59 us; skew 500 ppm
I20260812 00:33:24.167376 32001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:24 dist-test-slave-c12x krb5kdc[31981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494804, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:24.173825 32001 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:33:24.175410 32001 webserver.cc:460] Webserver started at http://127.29.190.190:37187/ using document root <none> and password file <none>
I20260812 00:33:24.176174 32001 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:24.176280 32001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:24.176540 32001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:24.179601 32001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "46935c1ae48e43299a0895f641b5385a"
format_stamp: "Formatted at 2026-08-12 00:33:24 on dist-test-slave-c12x"
server_key: "980ca1f206c69ae86b51dbe1a08a3120"
server_key_iv: "ed14c5de2f3eb453d4621003a2ca8fd7"
server_key_version: "encryptionkey@0"
I20260812 00:33:24.180341 32001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "46935c1ae48e43299a0895f641b5385a"
format_stamp: "Formatted at 2026-08-12 00:33:24 on dist-test-slave-c12x"
server_key: "980ca1f206c69ae86b51dbe1a08a3120"
server_key_iv: "ed14c5de2f3eb453d4621003a2ca8fd7"
server_key_version: "encryptionkey@0"
I20260812 00:33:24.185524 32001 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:33:24.189023 32021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:24.190423 32001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 00:33:24.190624 32001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "46935c1ae48e43299a0895f641b5385a"
format_stamp: "Formatted at 2026-08-12 00:33:24 on dist-test-slave-c12x"
server_key: "980ca1f206c69ae86b51dbe1a08a3120"
server_key_iv: "ed14c5de2f3eb453d4621003a2ca8fd7"
server_key_version: "encryptionkey@0"
I20260812 00:33:24.190832 32001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:24.231223 32001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:24.235329 32001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:24.235666 32001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:24.255213 32001 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:41503
I20260812 00:33:24.255231 32098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:41503 every 8 connection(s)
I20260812 00:33:24.256860 32001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:24.260840 32100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:24.266795 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32001
I20260812 00:33:24.266943 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:24.267483 30458 external_mini_cluster.cc:1428] Setting key b2268bd82cecb0c2417bf1cb8aa01b0a
I20260812 00:33:24.272631 32100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a: Bootstrap starting.
I20260812 00:33:24.275846 32100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:24.276939 32100 log.cc:824] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:24.280220 32100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a: No bootstrap required, opened a new log
Aug 12 00:33:24 dist-test-slave-c12x krb5kdc[31981](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:33:24.291136 32100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46935c1ae48e43299a0895f641b5385a" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41503 } }
I20260812 00:33:24.291646 32100 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:24.291783 32100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46935c1ae48e43299a0895f641b5385a, State: Initialized, Role: FOLLOWER
I20260812 00:33:24.292626 32106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:24.269405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49647 (local address 127.29.190.190:41503)
0812 00:33:24.270331 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:24.270347 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:24.270389 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:33:24.272209 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:24.272234 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:24.272645 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:24.273094 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:24.274655 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:24.276126 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:24.277565 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:24.278409 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:24.278612 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:24.283162 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:24.283173 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:24.283193 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:24.283259 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:24.287600 (+ 4341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:24.288276 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:24.288286 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:24.288295 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:24.288557 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:24.288974 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:24.288979 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:24.288983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:24.289805 (+ 822us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:24.290117 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:24.290608 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 00:33:24.291066 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":420,"threads_started":1}
I20260812 00:33:24.292506 32100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46935c1ae48e43299a0895f641b5385a" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41503 } }
I20260812 00:33:24.292833 32100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:24.293047 32100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:24.293251 32100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:24.296347 32100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46935c1ae48e43299a0895f641b5385a" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41503 } }
I20260812 00:33:24.296932 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:24.296907 32100 leader_election.cc:302] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46935c1ae48e43299a0895f641b5385a; no voters:
I20260812 00:33:24.297724 32100 leader_election.cc:288] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:24.297868 32108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:24.299491 32108 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [term 1 LEADER]: Becoming Leader. State: Replica: 46935c1ae48e43299a0895f641b5385a, State: Running, Role: LEADER
I20260812 00:33:24.300048 32100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:24.300251 32108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46935c1ae48e43299a0895f641b5385a" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41503 } }
I20260812 00:33:24.304075 32109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46935c1ae48e43299a0895f641b5385a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46935c1ae48e43299a0895f641b5385a" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41503 } } }
I20260812 00:33:24.304435 32109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:24.303596 32110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46935c1ae48e43299a0895f641b5385a. Latest consensus state: current_term: 1 leader_uuid: "46935c1ae48e43299a0895f641b5385a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46935c1ae48e43299a0895f641b5385a" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41503 } } }
I20260812 00:33:24.304904 32110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:24.311393 32124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:24.316920 32124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:24.328572 32106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:24.310371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53267 (local address 127.29.190.190:41503)
0812 00:33:24.310684 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:24.310698 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:24.311097 (+ 399us) server_negotiation.cc:407] Connection header received
0812 00:33:24.311398 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:24.311404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:24.311511 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:24.311646 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:24.313333 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:24.314554 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:24.316333 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:24.317061 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:24.317193 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:24.320549 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:24.320556 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:24.320562 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:24.320602 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:24.324611 (+ 4009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:24.325480 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:24.325486 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:24.325490 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:24.325642 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:24.326099 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:24.326105 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:24.326108 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:24.326585 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:24.326811 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:24.327941 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0812 00:33:24.328169 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260812 00:33:24.338137 32124 catalog_manager.cc:1347] Generated new cluster ID: 73f6f6096de9480887ebd306e6456540
I20260812 00:33:24.338267 32124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:24.365463 32124 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:24.366873 32124 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:24.375823 32124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46935c1ae48e43299a0895f641b5385a: Generated new TSK 0
I20260812 00:33:24.376976 32124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:24.388343 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32001
I20260812 00:33:24.389663 32088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:24.482484 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32001
2026-08-12T00:33:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2402 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:24 dist-test-slave-c12x krb5kdc[32150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:24 dist-test-slave-c12x krb5kdc[32150](info): set up 2 sockets
Aug 12 00:33:24 dist-test-slave-c12x krb5kdc[32150](info): commencing operation
krb5kdc: starting...
W20260812 00:33:25.851477 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.319s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:26 dist-test-slave-c12x krb5kdc[32150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:33:26.182354 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42997
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:35887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:42997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:26.546797 32167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:26.547207 32167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:26.547399 32167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:26.555022 32167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:26.555215 32167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:26.555341 32167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:26.555481 32167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:26.555572 32167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:26.566082 32167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:35887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:42997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:42997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:26.567612 32167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:26.569031 32167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:26.581112 32172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:26.581002 32173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:26.581050 32176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:26.582301 32167 server_base.cc:1034] running on GCE node
I20260812 00:33:26.583050 32167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:26.584554 32167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:26.585767 32167 hybrid_clock.cc:648] HybridClock initialized: now 1786494806585704 us; error 54 us; skew 500 ppm
I20260812 00:33:26.586146 32167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:26 dist-test-slave-c12x krb5kdc[32150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494806, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:26.589550 32167 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:33:26.591020 32167 webserver.cc:460] Webserver started at http://127.29.190.190:38339/ using document root <none> and password file <none>
I20260812 00:33:26.591812 32167 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:26.591920 32167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:26.592190 32167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:26.595196 32167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "c344ac9add714a1c83e1d2d73a99d6ec"
format_stamp: "Formatted at 2026-08-12 00:33:26 on dist-test-slave-c12x"
server_key: "67c031f473df7da5b2e984e4a3b937e9"
server_key_iv: "6001aa35be39bb03da8b6ef40055502b"
server_key_version: "encryptionkey@0"
I20260812 00:33:26.596004 32167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "c344ac9add714a1c83e1d2d73a99d6ec"
format_stamp: "Formatted at 2026-08-12 00:33:26 on dist-test-slave-c12x"
server_key: "67c031f473df7da5b2e984e4a3b937e9"
server_key_iv: "6001aa35be39bb03da8b6ef40055502b"
server_key_version: "encryptionkey@0"
I20260812 00:33:26.601333 32167 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:33:26.605000 32187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:26.606377 32167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:33:26.606550 32167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "c344ac9add714a1c83e1d2d73a99d6ec"
format_stamp: "Formatted at 2026-08-12 00:33:26 on dist-test-slave-c12x"
server_key: "67c031f473df7da5b2e984e4a3b937e9"
server_key_iv: "6001aa35be39bb03da8b6ef40055502b"
server_key_version: "encryptionkey@0"
I20260812 00:33:26.606789 32167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:26.621006 32167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:26.625645 32167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:26.625974 32167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:26.647531 32167 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:42997
I20260812 00:33:26.647604 32259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:42997 every 8 connection(s)
I20260812 00:33:26.649137 32167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:26.653012 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32167
I20260812 00:33:26.653218 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:26.653316 32260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:26.653765 30458 external_mini_cluster.cc:1428] Setting key 4dea1bde59f5578f98c3aece89931dc3
I20260812 00:33:26.669410 32263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:26.655870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42409 (local address 127.29.190.190:42997)
0812 00:33:26.656845 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:26.656861 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:26.656911 (+ 50us) server_negotiation.cc:407] Connection header received
0812 00:33:26.658761 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:26.658793 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:26.659337 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:26.659839 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:26.660395 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:26.662471 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:26.663998 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:26.665097 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:26.665289 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:26.666492 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:26.666515 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:26.666535 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:26.667289 (+ 754us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:26.667394 (+ 105us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:26.667427 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:26.667570 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:26.667780 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 00:33:26.668053 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":374,"threads_started":1}
I20260812 00:33:26.669457 32260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec: Bootstrap starting.
I20260812 00:33:26.672842 32260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:26.673269 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:26.673929 32260 log.cc:824] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:26.676877 32260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec: No bootstrap required, opened a new log
I20260812 00:33:26.684576 32263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:26.677960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35701 (local address 127.29.190.190:42997)
0812 00:33:26.678133 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:26.678139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:26.678536 (+ 397us) server_negotiation.cc:407] Connection header received
0812 00:33:26.678694 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:26.678705 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:26.678791 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:26.678893 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:26.679400 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:26.680591 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:26.681897 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:26.682630 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:26.682763 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:26.683782 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:26.683788 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:26.683795 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:26.683815 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:26.683860 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:26.683878 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:26.683968 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:26.684097 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 00:33:26.684199 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 00:33:26.686326 32260 raft_consensus.cc:348] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c344ac9add714a1c83e1d2d73a99d6ec" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42997 } }
I20260812 00:33:26.686726 32260 raft_consensus.cc:374] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:26.686847 32260 raft_consensus.cc:729] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c344ac9add714a1c83e1d2d73a99d6ec, State: Initialized, Role: FOLLOWER
I20260812 00:33:26.687508 32260 consensus_queue.cc:260] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c344ac9add714a1c83e1d2d73a99d6ec" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42997 } }
I20260812 00:33:26.687762 32260 raft_consensus.cc:388] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:26.687938 32260 raft_consensus.cc:482] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:26.688118 32260 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:26.690367 32260 raft_consensus.cc:504] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c344ac9add714a1c83e1d2d73a99d6ec" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42997 } }
I20260812 00:33:26.690999 32260 leader_election.cc:302] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c344ac9add714a1c83e1d2d73a99d6ec; no voters:
I20260812 00:33:26.691679 32260 leader_election.cc:288] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:26.691828 32278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:26.692553 32278 raft_consensus.cc:686] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [term 1 LEADER]: Becoming Leader. State: Replica: c344ac9add714a1c83e1d2d73a99d6ec, State: Running, Role: LEADER
I20260812 00:33:26.693159 32278 consensus_queue.cc:237] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c344ac9add714a1c83e1d2d73a99d6ec" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42997 } }
I20260812 00:33:26.693924 32260 sys_catalog.cc:564] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:26.696199 32283 sys_catalog.cc:455] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c344ac9add714a1c83e1d2d73a99d6ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c344ac9add714a1c83e1d2d73a99d6ec" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42997 } } }
I20260812 00:33:26.696630 32283 sys_catalog.cc:458] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:26.696472 32286 sys_catalog.cc:455] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader c344ac9add714a1c83e1d2d73a99d6ec. Latest consensus state: current_term: 1 leader_uuid: "c344ac9add714a1c83e1d2d73a99d6ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c344ac9add714a1c83e1d2d73a99d6ec" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 42997 } } }
I20260812 00:33:26.696867 32286 sys_catalog.cc:458] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:26.699232 32294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:26.704559 32294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:26.713733 32294 catalog_manager.cc:1347] Generated new cluster ID: 400a957b4b0f494780f6c8168eda8dff
I20260812 00:33:26.713862 32294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:26.730325 32294 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:26.732275 32294 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:26.749496 32294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c344ac9add714a1c83e1d2d73a99d6ec: Generated new TSK 0
I20260812 00:33:26.750593 32294 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:26.764026 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32167
W20260812 00:33:26.765281 32253 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42409
W20260812 00:33:26.766076 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32167: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:26.766244 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32167
2026-08-12T00:33:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2279 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:26 dist-test-slave-c12x krb5kdc[32314](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:26 dist-test-slave-c12x krb5kdc[32314](info): set up 2 sockets
Aug 12 00:33:26 dist-test-slave-c12x krb5kdc[32314](info): commencing operation
krb5kdc: starting...
W20260812 00:33:28.132650 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:28 dist-test-slave-c12x krb5kdc[32314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:33:28.467167 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:35441
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:40843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:35441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:28.826202 32332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:28.826669 32332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:28.826858 32332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:28.838353 32332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:28.838523 32332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:28.838608 32332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:28.838743 32332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:28.838846 32332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:28.854645 32332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:35441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:35441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:28.856648 32332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:28.858655 32332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:28.874718 32337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:28.874735 32338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:28.875795 32340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:28.876267 32332 server_base.cc:1034] running on GCE node
I20260812 00:33:28.877238 32332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:28.879354 32332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:28.880659 32332 hybrid_clock.cc:648] HybridClock initialized: now 1786494808880563 us; error 69 us; skew 500 ppm
I20260812 00:33:28.881062 32332 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:28 dist-test-slave-c12x krb5kdc[32314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494808, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:28.884574 32332 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:33:28.886219 32332 webserver.cc:460] Webserver started at http://127.29.190.190:40297/ using document root <none> and password file <none>
I20260812 00:33:28.886940 32332 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:28.887053 32332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:28.887315 32332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:28.890727 32332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "42ec0919b812416f9649f26c755616d5"
format_stamp: "Formatted at 2026-08-12 00:33:28 on dist-test-slave-c12x"
server_key: "a08225b607b3353265334ddd661d67f6"
server_key_iv: "8ec1e5f1a277904a36f2a9d18146b027"
server_key_version: "encryptionkey@0"
I20260812 00:33:28.891600 32332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "42ec0919b812416f9649f26c755616d5"
format_stamp: "Formatted at 2026-08-12 00:33:28 on dist-test-slave-c12x"
server_key: "a08225b607b3353265334ddd661d67f6"
server_key_iv: "8ec1e5f1a277904a36f2a9d18146b027"
server_key_version: "encryptionkey@0"
I20260812 00:33:28.897142 32332 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 00:33:28.901091 32351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:28.902635 32332 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:33:28.902799 32332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "42ec0919b812416f9649f26c755616d5"
format_stamp: "Formatted at 2026-08-12 00:33:28 on dist-test-slave-c12x"
server_key: "a08225b607b3353265334ddd661d67f6"
server_key_iv: "8ec1e5f1a277904a36f2a9d18146b027"
server_key_version: "encryptionkey@0"
I20260812 00:33:28.903000 32332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:28.909403 32332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:28.914088 32332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:28.914348 32332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:28.936898 32332 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:35441
I20260812 00:33:28.936921 32435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:35441 every 8 connection(s)
I20260812 00:33:28.938596 32332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:28.941501 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32332
I20260812 00:33:28.941717 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:28.942270 30458 external_mini_cluster.cc:1428] Setting key 8aa80f9c2d991f184f1967f74c374ddc
I20260812 00:33:28.943272 32437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:28.951200 32444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:28.944288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39183 (local address 127.29.190.190:35441)
0812 00:33:28.945140 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:28.945154 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:28.945205 (+ 51us) server_negotiation.cc:407] Connection header received
0812 00:33:28.947039 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:28.947068 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:28.947580 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:28.948045 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:28.949077 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:28.949089 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:28.949140 (+ 51us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:28.949167 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:28.949252 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:28.949286 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:28.949531 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:28.949661 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 00:33:28.949868 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":365,"threads_started":1}
I20260812 00:33:28.956169 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:28.958988 32437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5: Bootstrap starting.
I20260812 00:33:28.962884 32437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:28.963855 32444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:28.960895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34373 (local address 127.29.190.190:35441)
0812 00:33:28.961084 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:28.961088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:28.961694 (+ 606us) server_negotiation.cc:407] Connection header received
0812 00:33:28.961921 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:28.961927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:28.961999 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:28.962108 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:28.963085 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:28.963094 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:28.963099 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 00:33:28.963118 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:28.963166 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 00:33:28.963181 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:28.963346 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:28.963538 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 00:33:28.963594 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:33:28.964350 32437 log.cc:824] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:28.967415 32437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5: No bootstrap required, opened a new log
I20260812 00:33:28.975327 32437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42ec0919b812416f9649f26c755616d5" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35441 } }
I20260812 00:33:28.975809 32437 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 00:33:28.975950 32437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ec0919b812416f9649f26c755616d5, State: Initialized, Role: FOLLOWER
I20260812 00:33:28.976542 32437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42ec0919b812416f9649f26c755616d5" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35441 } }
I20260812 00:33:28.976799 32437 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 00:33:28.976955 32437 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 00:33:28.977167 32437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:28.979875 32437 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42ec0919b812416f9649f26c755616d5" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35441 } }
I20260812 00:33:28.980355 32437 leader_election.cc:302] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42ec0919b812416f9649f26c755616d5; no voters:
I20260812 00:33:28.980903 32437 leader_election.cc:288] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 00:33:28.981071 32455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:28.981789 32455 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [term 1 LEADER]: Becoming Leader. State: Replica: 42ec0919b812416f9649f26c755616d5, State: Running, Role: LEADER
I20260812 00:33:28.982316 32455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42ec0919b812416f9649f26c755616d5" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35441 } }
I20260812 00:33:28.983229 32437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:28.985771 32458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42ec0919b812416f9649f26c755616d5. Latest consensus state: current_term: 1 leader_uuid: "42ec0919b812416f9649f26c755616d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42ec0919b812416f9649f26c755616d5" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35441 } } }
I20260812 00:33:28.986276 32458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:28.987692 32457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42ec0919b812416f9649f26c755616d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42ec0919b812416f9649f26c755616d5" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35441 } } }
I20260812 00:33:28.988073 32457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:28.988435 32465 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:28.994063 32465 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:29.003520 32465 catalog_manager.cc:1347] Generated new cluster ID: 717e707c34be43d1aa2efa828e75a8de
I20260812 00:33:29.003654 32465 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:29.032577 32465 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:29.033033 32465 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:29.042791 32465 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42ec0919b812416f9649f26c755616d5: Generated new TSK 0
I20260812 00:33:29.043856 32465 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:29.055447 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32332
W20260812 00:33:29.056660 32428 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39183
W20260812 00:33:29.057472 30458 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32332: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 00:33:29.057641 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32332
2026-08-12T00:33:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2293 ms)
[----------] 18 tests from AuthTokenIssuingTest (41448 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:29 dist-test-slave-c12x krb5kdc[32483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:29 dist-test-slave-c12x krb5kdc[32483](info): set up 2 sockets
Aug 12 00:33:29 dist-test-slave-c12x krb5kdc[32483](info): commencing operation
krb5kdc: starting...
W20260812 00:33:30.416546 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:30 dist-test-slave-c12x krb5kdc[32483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:33:30.767022 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:41769
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:40837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:41769,127.29.190.189:35195,127.29.190.188:34395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:31.135262 32501 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:33:31.135766 32501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:31.135906 32501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:31.136056 32501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:31.143982 32501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:31.144115 32501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:31.144248 32501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:31.144340 32501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:31.144462 32501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:31.155821 32501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:41769,127.29.190.189:35195,127.29.190.188:34395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:41769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:31.157286 32501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:31.158726 32501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:31.171717 32514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:31.171836 32512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:31.171859 32511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:31.172868 32501 server_base.cc:1034] running on GCE node
I20260812 00:33:31.173789 32501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:31.175349 32501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:31.176658 32501 hybrid_clock.cc:648] HybridClock initialized: now 1786494811176593 us; error 37 us; skew 500 ppm
I20260812 00:33:31.177045 32501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:31 dist-test-slave-c12x krb5kdc[32483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494811, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:31.184155 32501 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:33:31.185943 32501 webserver.cc:460] Webserver started at http://127.29.190.190:41259/ using document root <none> and password file <none>
I20260812 00:33:31.186769 32501 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:31.186915 32501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:31.187310 32501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:31.190835 32501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "a165cfeadbdb473fb71b340b3b89e9c6"
format_stamp: "Formatted at 2026-08-12 00:33:31 on dist-test-slave-c12x"
server_key: "daea0d5b00aa12e1f38aa4d210bd583f"
server_key_iv: "1db3e64b25eed9b9a491097649e99881"
server_key_version: "encryptionkey@0"
I20260812 00:33:31.191812 32501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "a165cfeadbdb473fb71b340b3b89e9c6"
format_stamp: "Formatted at 2026-08-12 00:33:31 on dist-test-slave-c12x"
server_key: "daea0d5b00aa12e1f38aa4d210bd583f"
server_key_iv: "1db3e64b25eed9b9a491097649e99881"
server_key_version: "encryptionkey@0"
I20260812 00:33:31.197613 32501 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 00:33:31.201417 32523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:31.202831 32501 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:33:31.203035 32501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "a165cfeadbdb473fb71b340b3b89e9c6"
format_stamp: "Formatted at 2026-08-12 00:33:31 on dist-test-slave-c12x"
server_key: "daea0d5b00aa12e1f38aa4d210bd583f"
server_key_iv: "1db3e64b25eed9b9a491097649e99881"
server_key_version: "encryptionkey@0"
I20260812 00:33:31.203285 32501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:31.225116 32501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:31.229714 32501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:31.230026 32501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:31.249805 32501 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:41769
I20260812 00:33:31.249840 32596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:41769 every 8 connection(s)
I20260812 00:33:31.251242 32501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:31.255043 32597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:31.261828 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32501
I20260812 00:33:31.262048 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:31.261564 32597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:31.262848 30458 external_mini_cluster.cc:1428] Setting key f0c027712a8038cbd9a08ef83a977215
Aug 12 00:33:31 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494811, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:33:31.289405 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.265352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:41769 (local address 127.0.0.1:44354)
0812 00:33:31.266179 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.266239 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:31.270111 (+ 3872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:31.271051 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:31.271061 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:31.271938 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:31.272501 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:31.272530 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.274184 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.274192 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:31.276110 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:31.276130 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.277468 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.277473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:31.277655 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:31.278374 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:31.278397 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:31.280631 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:31.285230 (+ 4599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:31.285240 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:31.285250 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:31.285682 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:31.286183 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:31.286186 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:31.286188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:31.286347 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:31.287393 (+ 1046us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:31.287399 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:31.287648 (+ 249us) client_negotiation.cc:769] Sending connection context
0812 00:33:31.287862 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 00:33:31.288303 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":358,"threads_started":1}
I20260812 00:33:31.289506 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.266623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44354 (local address 127.29.190.190:41769)
0812 00:33:31.268094 (+ 1471us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:31.268108 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:31.268163 (+ 55us) server_negotiation.cc:407] Connection header received
0812 00:33:31.270537 (+ 2374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:31.270543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:31.270787 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:31.270963 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:31.272774 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.274007 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.276276 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.277222 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.277440 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:31.280911 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:31.280925 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:31.280944 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:31.280987 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:31.285084 (+ 4097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:31.285842 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:31.285853 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:31.285859 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:31.286069 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:31.286483 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:31.286491 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:31.286497 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:31.287252 (+ 755us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:31.287499 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:31.288081 (+ 582us) server_negotiation.cc:299] Negotiation successful
0812 00:33:31.288510 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":1175,"thread_start_us":997,"threads_started":1}
I20260812 00:33:31.292838 32597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:31.294139 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.293743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34350)
0812 00:33:31.293911 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.294020 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 00:33:31.294590 32528 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
I20260812 00:33:31.296387 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.295971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34364)
0812 00:33:31.296162 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.296237 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260812 00:33:31.296736 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:35195: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.29.190.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab.
Entry for principal kudu/127.29.190.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab.
I20260812 00:33:31.336491 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.189:35195
--webserver_interface=127.29.190.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab
--principal=kudu/127.29.190.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:40837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:41769,127.29.190.189:35195,127.29.190.188:34395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:33:31.346165 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } attempt: 1
I20260812 00:33:31.347631 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.346987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34372)
0812 00:33:31.347252 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.347400 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 00:33:31.348780 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.348416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34374)
0812 00:33:31.348575 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.348652 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 00:33:31.348984 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:35195: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
I20260812 00:33:31.417235 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } attempt: 2
I20260812 00:33:31.418582 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.418032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34388)
0812 00:33:31.418332 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.418439 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260812 00:33:31.419796 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.419369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34394)
0812 00:33:31.419568 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.419661 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260812 00:33:31.420079 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:35195: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
I20260812 00:33:31.511339 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } attempt: 3
I20260812 00:33:31.512620 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.512167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34408)
0812 00:33:31.512369 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.512463 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 00:33:31.513832 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.513421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34422)
0812 00:33:31.513575 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.513699 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 00:33:31.514071 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:35195: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
I20260812 00:33:31.657344 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } attempt: 4
I20260812 00:33:31.658804 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.658187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34428)
0812 00:33:31.658558 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.658661 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213}
I20260812 00:33:31.660010 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.659660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34438)
0812 00:33:31.659800 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.659884 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 00:33:31.660251 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:35195: Network error: Client connection negotiation failed: client connection to 127.29.190.189:35195: connect: Connection refused (error 111)
W20260812 00:33:31.705212 32612 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:33:31.705610 32612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:31.705742 32612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:31.705892 32612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:31.713606 32612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:31.713709 32612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:31.713809 32612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:31.713912 32612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:31.714025 32612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:31.724694 32612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:41769,127.29.190.189:35195,127.29.190.188:34395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab
--principal=kudu/127.29.190.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.189:35195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.190.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:31.726130 32612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:31.727617 32612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:31.739964 32619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:31.740026 32618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:31.740060 32622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:31.741154 32612 server_base.cc:1034] running on GCE node
I20260812 00:33:31.741951 32612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:31.743407 32612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:31.744683 32612 hybrid_clock.cc:648] HybridClock initialized: now 1786494811744598 us; error 60 us; skew 500 ppm
I20260812 00:33:31.745045 32612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:31 dist-test-slave-c12x krb5kdc[32483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494811, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:31.748477 32612 init.cc:377] Logged in from keytab as kudu/127.29.190.189@KRBTEST.COM (short username kudu)
I20260812 00:33:31.750111 32612 webserver.cc:460] Webserver started at http://127.29.190.189:37103/ using document root <none> and password file <none>
I20260812 00:33:31.750838 32612 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:31.750929 32612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:31.751207 32612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:31.754401 32612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/data/instance:
uuid: "649391e0af254948b96a19e6725e375c"
format_stamp: "Formatted at 2026-08-12 00:33:31 on dist-test-slave-c12x"
server_key: "8f65606fcf5e8c8ba46d78dd4d6b2aee"
server_key_iv: "fa309165f6321aad1c44fa649d33828d"
server_key_version: "encryptionkey@0"
I20260812 00:33:31.755226 32612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/wal/instance:
uuid: "649391e0af254948b96a19e6725e375c"
format_stamp: "Formatted at 2026-08-12 00:33:31 on dist-test-slave-c12x"
server_key: "8f65606fcf5e8c8ba46d78dd4d6b2aee"
server_key_iv: "fa309165f6321aad1c44fa649d33828d"
server_key_version: "encryptionkey@0"
I20260812 00:33:31.760792 32612 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 00:33:31.764351 32631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:31.765952 32612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:33:31.766156 32612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/wal
uuid: "649391e0af254948b96a19e6725e375c"
format_stamp: "Formatted at 2026-08-12 00:33:31 on dist-test-slave-c12x"
server_key: "8f65606fcf5e8c8ba46d78dd4d6b2aee"
server_key_iv: "fa309165f6321aad1c44fa649d33828d"
server_key_version: "encryptionkey@0"
I20260812 00:33:31.766402 32612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:31.791337 32612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:31.795987 32612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:31.796300 32612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:31.816736 32612 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.189:35195
I20260812 00:33:31.816783 32701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.189:35195 every 8 connection(s)
I20260812 00:33:31.818253 32612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
I20260812 00:33:31.819773 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32612
I20260812 00:33:31.819967 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-1/wal/instance
I20260812 00:33:31.820540 30458 external_mini_cluster.cc:1428] Setting key a54f4a45e574a6a18e4752f7674100c4
I20260812 00:33:31.823136 32702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:31.833580 32702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:33:31 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494811, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.190.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.188@KRBTEST.COM" created.
I20260812 00:33:31.857033 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.837096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44360 (local address 127.29.190.190:41769)
0812 00:33:31.837758 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:31.837763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:31.838707 (+ 944us) server_negotiation.cc:407] Connection header received
0812 00:33:31.840903 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:31.840909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:31.841008 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:31.841133 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:31.842757 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.843599 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.845141 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.845564 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.845701 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:31.850137 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:31.850143 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:31.850147 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:31.850193 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:31.853488 (+ 3295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:31.854370 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:31.854375 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:31.854377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:31.854518 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:31.854996 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:31.855000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:31.855002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:31.855342 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:31.855605 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:31.856419 (+ 814us) server_negotiation.cc:299] Negotiation successful
0812 00:33:31.856645 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":395,"threads_started":1}
I20260812 00:33:31.858064 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.837712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:41769 (local address 127.0.0.1:44360)
0812 00:33:31.838519 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.838561 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:31.840597 (+ 2036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:31.841399 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:31.841408 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:31.841953 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:31.842529 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:31.842546 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.843772 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.843776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:31.844987 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:31.845000 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.845825 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.845833 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:31.846072 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:31.846805 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:31.846834 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:31.849831 (+ 2997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:31.853652 (+ 3821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:31.853659 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:31.853673 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:31.854226 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:31.854645 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:31.854648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:31.854651 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:31.854886 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:31.855564 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:31.855576 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:31.856041 (+ 465us) client_negotiation.cc:769] Sending connection context
0812 00:33:31.856332 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 00:33:31.856896 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":326,"threads_started":1}
I20260812 00:33:31.859951 32702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:33:31 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494811, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:33:31.877367 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.860840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34454)
0812 00:33:31.861063 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.861088 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:31.861201 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:31.862189 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:31.862201 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:31.862723 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:31.862955 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:31.862972 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.864448 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.864457 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:31.865968 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:31.865985 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.866788 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.866796 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:31.867029 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:31.867715 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:31.867743 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:31.870664 (+ 2921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:31.874429 (+ 3765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:31.874436 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:31.874441 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:31.874836 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:31.875250 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:31.875257 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:31.875260 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:31.875479 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:31.876157 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:31.876164 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:31.876327 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 00:33:31.876500 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 00:33:31.876804 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 00:33:31.877416 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.860999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34454 (local address 127.29.190.189:35195)
0812 00:33:31.861767 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:31.861773 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:31.861799 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:33:31.861843 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:31.861849 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:31.862021 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:31.862143 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:31.863142 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.864303 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.866115 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.866633 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.866730 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:31.871006 (+ 4276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:31.871015 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:31.871028 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:31.871057 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:31.874254 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:31.874987 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:31.875004 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:31.875006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:31.875128 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:31.875614 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:31.875619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:31.875624 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:31.876015 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:31.876264 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:31.876667 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 00:33:31.876930 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":616,"thread_start_us":427,"threads_started":1}
I20260812 00:33:31.880474 32702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:31.881704 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.881184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41420)
0812 00:33:31.881375 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.881536 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260812 00:33:31.882035 32635 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
I20260812 00:33:31.883750 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.883333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41430)
0812 00:33:31.883557 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.883641 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 00:33:31.884130 32702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab.
Entry for principal kudu/127.29.190.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab.
I20260812 00:33:31.895165 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.188:34395
--webserver_interface=127.29.190.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab
--principal=kudu/127.29.190.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:40837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:41769,127.29.190.189:35195,127.29.190.188:34395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:33:31.933523 32702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 1
I20260812 00:33:31.934927 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.934352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41434)
0812 00:33:31.934604 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.934732 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260812 00:33:31.936270 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.935824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41446)
0812 00:33:31.936010 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.936120 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 00:33:31.936558 32702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
I20260812 00:33:31.959591 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } attempt: 5
Aug 12 00:33:31 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494811, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:33:31.976176 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.960599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34468 (local address 127.29.190.189:35195)
0812 00:33:31.960848 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:31.960867 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:31.960893 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:33:31.961065 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:31.961076 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:31.961147 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:31.961272 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:31.962196 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.962953 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.964336 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.965168 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.965311 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:31.969673 (+ 4362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:31.969679 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:31.969683 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:31.969722 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:31.972999 (+ 3277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:31.973805 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:31.973814 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:31.973824 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:31.973972 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:31.974448 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:31.974455 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:31.974458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:31.974844 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:31.975027 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:31.975547 (+ 520us) server_negotiation.cc:299] Negotiation successful
0812 00:33:31.975798 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260812 00:33:31.976200 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.960466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34468)
0812 00:33:31.960698 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.960732 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:31.960890 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:31.961326 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:31.961333 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:31.961816 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:31.962023 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:31.962034 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.963115 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.963122 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:31.964154 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:31.964169 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:31.965514 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:31.965522 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:31.965803 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:31.966623 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:31.966652 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:31.969413 (+ 2761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:31.973189 (+ 3776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:31.973196 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:31.973200 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:31.973648 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:31.974110 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:31.974116 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:31.974120 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:31.974307 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:31.974989 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:31.974994 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:31.975186 (+ 192us) client_negotiation.cc:769] Sending connection context
0812 00:33:31.975357 (+ 171us) client_negotiation.cc:240] Negotiation successful
0812 00:33:31.975771 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 00:33:31.977599 32597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:31.978740 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.978305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41448)
0812 00:33:31.978489 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.978580 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 00:33:31.979751 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:31.979377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41464)
0812 00:33:31.979563 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:31.979654 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260812 00:33:31.979990 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
I20260812 00:33:32.004812 32702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 2
I20260812 00:33:32.006182 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.005669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41468)
0812 00:33:32.005894 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.006007 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 00:33:32.007581 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.007060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41474)
0812 00:33:32.007237 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.007318 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 00:33:32.007831 32702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
I20260812 00:33:32.031226 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 1
I20260812 00:33:32.032647 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.032048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41490)
0812 00:33:32.032309 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.032431 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 00:33:32.033886 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.033489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41504)
0812 00:33:32.033657 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.033748 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 00:33:32.034173 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
I20260812 00:33:32.099112 32702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 3
I20260812 00:33:32.100418 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.099908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41516)
0812 00:33:32.100149 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.100253 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 00:33:32.101835 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.101311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41524)
0812 00:33:32.101625 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.101709 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202}
W20260812 00:33:32.102048 32702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
I20260812 00:33:32.102414 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 2
I20260812 00:33:32.103569 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.102998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41536)
0812 00:33:32.103228 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.103331 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 00:33:32.104758 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.104371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41552)
0812 00:33:32.104537 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.104623 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 00:33:32.105005 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
I20260812 00:33:32.211261 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 3
I20260812 00:33:32.212563 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.212001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41560)
0812 00:33:32.212250 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.212364 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 00:33:32.213727 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.213293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41570)
0812 00:33:32.213493 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.213584 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260812 00:33:32.213958 32597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
I20260812 00:33:32.245292 32702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 4
I20260812 00:33:32.246634 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.246019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41572)
0812 00:33:32.246306 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.246423 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 00:33:32.247756 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.247359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41584)
0812 00:33:32.247532 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.247621 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 00:33:32.248047 32702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:34395: Network error: Client connection negotiation failed: client connection to 127.29.190.188:34395: connect: Connection refused (error 111)
W20260812 00:33:32.259550 32710 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:33:32.259938 32710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:32.260046 32710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:32.260196 32710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:32.267383 32710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:32.267549 32710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:32.267670 32710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:32.267768 32710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:32.267854 32710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:32.277829 32710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:40837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:41769,127.29.190.189:35195,127.29.190.188:34395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab
--principal=kudu/127.29.190.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.188:34395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.190.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:32.279126 32710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:32.280520 32710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:32.292883 32715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:32.292965 32716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:32.292943 32721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:32.294030 32710 server_base.cc:1034] running on GCE node
I20260812 00:33:32.294880 32710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:32.296428 32710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:32.297663 32710 hybrid_clock.cc:648] HybridClock initialized: now 1786494812297608 us; error 41 us; skew 500 ppm
I20260812 00:33:32.298002 32710 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494812, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:32.301296 32710 init.cc:377] Logged in from keytab as kudu/127.29.190.188@KRBTEST.COM (short username kudu)
I20260812 00:33:32.302763 32710 webserver.cc:460] Webserver started at http://127.29.190.188:39581/ using document root <none> and password file <none>
I20260812 00:33:32.303572 32710 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:32.303717 32710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:32.304050 32710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:32.307174 32710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/data/instance:
uuid: "7161807701a14213bcbccb44bfc075a3"
format_stamp: "Formatted at 2026-08-12 00:33:32 on dist-test-slave-c12x"
server_key: "f790e0d57cd74f95bed2a8ce1c18dbe2"
server_key_iv: "f01ca0988066aa8142a416d0a92e8bd8"
server_key_version: "encryptionkey@0"
I20260812 00:33:32.308143 32710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/wal/instance:
uuid: "7161807701a14213bcbccb44bfc075a3"
format_stamp: "Formatted at 2026-08-12 00:33:32 on dist-test-slave-c12x"
server_key: "f790e0d57cd74f95bed2a8ce1c18dbe2"
server_key_iv: "f01ca0988066aa8142a416d0a92e8bd8"
server_key_version: "encryptionkey@0"
I20260812 00:33:32.313395 32710 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 00:33:32.316943 32733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:32.318213 32710 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 00:33:32.318409 32710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/wal
uuid: "7161807701a14213bcbccb44bfc075a3"
format_stamp: "Formatted at 2026-08-12 00:33:32 on dist-test-slave-c12x"
server_key: "f790e0d57cd74f95bed2a8ce1c18dbe2"
server_key_iv: "f01ca0988066aa8142a416d0a92e8bd8"
server_key_version: "encryptionkey@0"
I20260812 00:33:32.318632 32710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:32.344450 32710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:32.348881 32710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:32.349210 32710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:32.369190 32710 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.188:34395
I20260812 00:33:32.369220 347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.188:34395 every 8 connection(s)
I20260812 00:33:32.370762 32710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
I20260812 00:33:32.374644 349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:32.379362 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 32710
I20260812 00:33:32.379596 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786494426716583-30458-0/minicluster-data/master-2/wal/instance
I20260812 00:33:32.380031 30458 external_mini_cluster.cc:1428] Setting key ddbacaff56fd65bf94f882e43632f1c8
I20260812 00:33:32.381520 349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:32.391202 32597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 4
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494812, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494811, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
I20260812 00:33:32.405426 355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.384275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44376 (local address 127.29.190.190:41769)
0812 00:33:32.384881 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.384890 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.385479 (+ 589us) server_negotiation.cc:407] Connection header received
0812 00:33:32.385962 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.385969 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.386075 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.386210 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.387749 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.388594 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.390401 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.390863 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.391035 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.396606 (+ 5571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.396613 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.396617 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.396659 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.400928 (+ 4269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.402090 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.402095 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.402099 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.402259 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.402834 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.402839 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.402843 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.403154 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.403319 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.404904 (+ 1585us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.405128 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":293,"threads_started":1}
I20260812 00:33:32.407640 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.381966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41594 (local address 127.29.190.188:34395)
0812 00:33:32.382863 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.382874 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.382916 (+ 42us) server_negotiation.cc:407] Connection header received
0812 00:33:32.385483 (+ 2567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.385510 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.385811 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.386022 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.387650 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.388851 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.390191 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.390728 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.390921 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.396954 (+ 6033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.396967 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.396987 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.397047 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.401474 (+ 4427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.402576 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.402590 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.402596 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.402789 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.403348 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.403354 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.403361 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.404016 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.404417 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.404765 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.405975 (+ 1210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":908,"server-negotiator.queue_time_us":673,"thread_start_us":389,"threads_started":1}
I20260812 00:33:32.407670 357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.384295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:41769 (local address 127.0.0.1:44376)
0812 00:33:32.385293 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.385332 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:32.385702 (+ 370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:32.386294 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:32.386302 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:32.386995 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:32.387545 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.387572 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.388781 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.388788 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.390212 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.390226 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.391619 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.391631 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.391872 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.392746 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:32.392788 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:32.396357 (+ 3569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:32.401149 (+ 4792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.401166 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.401184 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.401897 (+ 713us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.402398 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.402407 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.402413 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.402692 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.403301 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:32.403311 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:32.403887 (+ 576us) client_negotiation.cc:769] Sending connection context
0812 00:33:32.404209 (+ 322us) client_negotiation.cc:240] Negotiation successful
0812 00:33:32.405855 (+ 1646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"mutex_wait_us":41,"thread_start_us":544,"threads_started":1}
I20260812 00:33:32.408439 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.391939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41608)
0812 00:33:32.392237 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.392259 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:32.392374 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:32.393369 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:32.393377 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:32.393825 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:32.393977 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.393985 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.395565 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.395573 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.397207 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.397230 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.398259 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.398265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.398501 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.399175 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:32.399207 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:32.401469 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:32.405726 (+ 4257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.405729 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.405732 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.406113 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.406510 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.406516 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.406519 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.406653 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.407291 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:32.407296 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:32.407507 (+ 211us) client_negotiation.cc:769] Sending connection context
0812 00:33:32.407664 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 00:33:32.407945 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175}
I20260812 00:33:32.408493 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.392085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41608 (local address 127.29.190.188:34395)
0812 00:33:32.393095 (+ 1010us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.393099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.393117 (+ 18us) server_negotiation.cc:407] Connection header received
0812 00:33:32.393156 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.393159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.393209 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.393342 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.394159 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.395406 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.397403 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.398096 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.398242 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.401714 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.401719 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.401722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.401752 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.405603 (+ 3851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.406241 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.406247 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.406251 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.406388 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.406797 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.406802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.406806 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.407146 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.407310 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.407761 (+ 451us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.408055 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":902,"thread_start_us":724,"threads_started":1}
I20260812 00:33:32.410125 349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:32.414952 32597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6: Bootstrap starting.
I20260812 00:33:32.419328 32597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6: Neither blocks nor log segments found. Creating new log.
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:33:32.420835 32597 log.cc:824] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494812, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:33:32.424675 32597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6: No bootstrap required, opened a new log
I20260812 00:33:32.429736 355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.411253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44388 (local address 127.29.190.190:41769)
0812 00:33:32.411408 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.411416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.411701 (+ 285us) server_negotiation.cc:407] Connection header received
0812 00:33:32.411879 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.411885 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.411975 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.412080 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.413286 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.414006 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.415320 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.416071 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.416199 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.422316 (+ 6117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.422322 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.422327 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.422368 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.426135 (+ 3767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.427040 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.427046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.427050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.427232 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.427741 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.427752 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.427757 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.428196 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.428520 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.429049 (+ 529us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.429311 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 00:33:32.431571 357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.411137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:35195 (local address 127.0.0.1:34482)
0812 00:33:32.411452 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.411477 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:32.411596 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:32.416102 (+ 4506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:32.416107 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:32.416616 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:32.416849 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.416864 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.417943 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.417949 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.419528 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.419546 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.420484 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.420490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.420695 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.421315 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:32.421338 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:32.424084 (+ 2746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:32.428450 (+ 4366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.428457 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.428462 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.429052 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.429622 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.429627 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.429632 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.429843 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.430552 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:32.430557 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:32.430729 (+ 172us) client_negotiation.cc:769] Sending connection context
0812 00:33:32.430874 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 00:33:32.431189 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166}
I20260812 00:33:32.431617 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.415528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34482 (local address 127.29.190.189:35195)
0812 00:33:32.415747 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.415754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.415775 (+ 21us) server_negotiation.cc:407] Connection header received
0812 00:33:32.415837 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.415842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.415917 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.416021 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.417116 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.417777 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.419713 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.420325 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.420475 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.424316 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.424326 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.424337 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.424384 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.428304 (+ 3920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.429259 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.429265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.429270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.429450 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.430063 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.430068 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.430071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.430438 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.430593 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.430997 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.431211 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 00:33:32.433146 349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:32.436136 32597 raft_consensus.cc:348] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } }
I20260812 00:33:32.436609 32597 raft_consensus.cc:729] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a165cfeadbdb473fb71b340b3b89e9c6, State: Initialized, Role: FOLLOWER
I20260812 00:33:32.437182 32597 consensus_queue.cc:260] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } }
I20260812 00:33:32.440119 32597 sys_catalog.cc:564] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494812, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:33:32.438413 362 sys_catalog.cc:455] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.445869 362 sys_catalog.cc:458] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:32.448233 357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.433900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41612)
0812 00:33:32.434326 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.434346 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:32.434450 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:32.434807 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:32.434813 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:32.435294 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:32.435535 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.435548 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.436512 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.436519 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.437532 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.437546 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.438641 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.438648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.438856 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.439379 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:32.439396 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:32.441559 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:32.444979 (+ 3420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.444985 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.444989 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.445436 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.445917 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.445923 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.445927 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.446073 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.446938 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:32.446944 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:32.447142 (+ 198us) client_negotiation.cc:769] Sending connection context
0812 00:33:32.447306 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 00:33:32.447778 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311}
I20260812 00:33:32.448601 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.434012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41612 (local address 127.29.190.188:34395)
0812 00:33:32.434187 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.434193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.434421 (+ 228us) server_negotiation.cc:407] Connection header received
0812 00:33:32.434565 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.434570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.434649 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.434757 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.435679 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.436383 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.437683 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.438333 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.438454 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.441771 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.441780 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.441789 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.441818 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.444817 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.445560 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.445565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.445568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.445762 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.446206 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.446211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.446216 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.446705 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.446841 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.447561 (+ 720us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.448013 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":111,"server-negotiator.queue_time_us":64}
I20260812 00:33:32.452893 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.432239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34484 (local address 127.29.190.189:35195)
0812 00:33:32.432428 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.432435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.432454 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:33:32.432507 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.432512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.432587 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.432698 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.434219 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.435350 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.437419 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.438057 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.438831 (+ 774us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.445526 (+ 6695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.445537 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.445544 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.445606 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.449326 (+ 3720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.450461 (+ 1135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.450468 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.450472 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.450668 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.451222 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.451227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.451230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.451621 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.451919 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.452329 (+ 410us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.452568 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 00:33:32.454424 349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3: Bootstrap starting.
I20260812 00:33:32.458077 349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:32.459210 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:32.459511 349 log.cc:824] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:32.464236 32560 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a165cfeadbdb473fb71b340b3b89e9c6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44388
I20260812 00:33:32.464773 32560 raft_consensus.cc:482] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:33:32.465070 32560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:32.469528 349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3: No bootstrap required, opened a new log
W20260812 00:33:32.469576 374 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:33:32.469775 374 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:33:32.470513 32560 raft_consensus.cc:504] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } }
I20260812 00:33:32.474229 32560 leader_election.cc:288] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [CANDIDATE]: Term 1 election: Requested vote from peers 649391e0af254948b96a19e6725e375c (127.29.190.189:35195), 7161807701a14213bcbccb44bfc075a3 (127.29.190.188:34395)
I20260812 00:33:32.464627 32501 master_runner.cc:186] Error getting master registration for 127.29.190.189:35195: OK, instance_id { permanent_uuid: "649391e0af254948b96a19e6725e375c" instance_seqno: 1786494811810819 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:33:32.482949 32501 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 00:33:32.483176 32533 tablet.cc:2369] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:33:32.482667 349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } }
I20260812 00:33:32.484647 349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7161807701a14213bcbccb44bfc075a3, State: Initialized, Role: FOLLOWER
I20260812 00:33:32.485404 349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } }
I20260812 00:33:32.487226 380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.488339 380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:32.488829 349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:32.488890 312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7161807701a14213bcbccb44bfc075a3"
I20260812 00:33:32.489483 312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:32.493233 312 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a165cfeadbdb473fb71b340b3b89e9c6 in term 1.
I20260812 00:33:32.494016 32528 leader_election.cc:302] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7161807701a14213bcbccb44bfc075a3, a165cfeadbdb473fb71b340b3b89e9c6; no voters:
I20260812 00:33:32.494511 362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:32.495277 362 raft_consensus.cc:686] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [term 1 LEADER]: Becoming Leader. State: Replica: a165cfeadbdb473fb71b340b3b89e9c6, State: Running, Role: LEADER
I20260812 00:33:32.495893 362 consensus_queue.cc:237] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } }
I20260812 00:33:32.500300 383 sys_catalog.cc:455] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a165cfeadbdb473fb71b340b3b89e9c6. Latest consensus state: current_term: 1 leader_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.500779 383 sys_catalog.cc:458] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:32.516829 393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:32.521196 393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:32.547259 32702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } attempt: 5
I20260812 00:33:32.548254 312 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [term 1 FOLLOWER]: Refusing update from remote peer a165cfeadbdb473fb71b340b3b89e9c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:33:32.549528 383 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:33:32.557324 410 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
Aug 12 00:33:32 dist-test-slave-c12x krb5kdc[32483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494811, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
I20260812 00:33:32.566313 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.547986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:34395 (local address 127.0.0.1:41632)
0812 00:33:32.548429 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:32.548451 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:32.548565 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:32.549722 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:32.549728 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:32.550315 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:32.550540 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.550556 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.551970 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.551979 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.553394 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:32.553412 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.554681 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.554687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:32.554974 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.555653 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:32.555685 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:32.558786 (+ 3101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:32.563088 (+ 4302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.563094 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.563097 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.563660 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.564132 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:32.564139 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:32.564143 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:32.564375 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:32.565210 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:32.565215 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:32.565394 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 00:33:32.565553 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 00:33:32.565891 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309}
I20260812 00:33:32.567881 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.548814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41632 (local address 127.29.190.188:34395)
0812 00:33:32.549083 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.549089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.549129 (+ 40us) server_negotiation.cc:407] Connection header received
0812 00:33:32.549181 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.549187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.549296 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.549400 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.550711 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.551775 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.553584 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.554340 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.554474 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.559014 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.559021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.559025 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.559063 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.562920 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.563814 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.563819 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.563822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.563988 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.564518 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.564522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.564525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.564981 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.565137 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.566800 (+ 1663us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.567082 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260812 00:33:32.570446 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.517686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41628 (local address 127.29.190.188:34395)
0812 00:33:32.517893 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.517900 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.529753 (+ 11853us) server_negotiation.cc:407] Connection header received
0812 00:33:32.534740 (+ 4987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.534750 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.534878 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.534989 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.545263 (+ 10274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.546748 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.555594 (+ 8846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.556633 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.556762 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.561765 (+ 5003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.561772 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.561776 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.561815 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.565724 (+ 3909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.566613 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.566619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.566622 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.566774 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.567264 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.567272 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.567278 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.567750 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.568013 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.568584 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.569423 (+ 839us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:33:32.573391 355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.498763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44390 (local address 127.29.190.190:41769)
0812 00:33:32.499021 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.499031 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.516977 (+ 17946us) server_negotiation.cc:407] Connection header received
0812 00:33:32.520700 (+ 3723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.520710 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.520840 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.520947 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.530522 (+ 9575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.532069 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.542354 (+ 10285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.543466 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.543614 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.560414 (+ 16800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.560423 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.560428 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.560478 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.565024 (+ 4546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.565954 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.565962 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.565967 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.566127 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.571487 (+ 5360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.571493 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.571497 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.571903 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.572179 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.572764 (+ 585us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.573005 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 00:33:32.574704 32702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c: Bootstrap starting.
I20260812 00:33:32.577486 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:32.501244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34496 (local address 127.29.190.189:35195)
0812 00:33:32.501491 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.501501 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.525568 (+ 24067us) server_negotiation.cc:407] Connection header received
0812 00:33:32.525901 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.525911 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.526040 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.526134 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.538204 (+ 12070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.539720 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.551234 (+ 11514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:32.552248 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:32.552394 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:32.566670 (+ 14276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:32.566678 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:32.566685 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:32.566729 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:32.570417 (+ 3688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.574560 (+ 4143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.574565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.574568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.574752 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:32.575364 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:32.575370 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:32.575373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:32.575840 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:32.576073 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:32.576750 (+ 677us) server_negotiation.cc:299] Negotiation successful
0812 00:33:32.577106 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":80}
I20260812 00:33:32.579198 32702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:32.580703 32702 log.cc:824] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:32.583560 380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a165cfeadbdb473fb71b340b3b89e9c6. Latest consensus state: current_term: 1 leader_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.583909 380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:32.584411 32702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c: No bootstrap required, opened a new log
I20260812 00:33:32.565052 32710 master_runner.cc:186] Error getting master registration for 127.29.190.189:35195: OK, instance_id { permanent_uuid: "649391e0af254948b96a19e6725e375c" instance_seqno: 1786494811810819 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:33:32.587587 32710 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:33:32.592937 383 sys_catalog.cc:455] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.593252 383 sys_catalog.cc:458] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:32.594340 393 catalog_manager.cc:1347] Generated new cluster ID: a232b8eaf4d8466c950deb63f0cf8b8e
I20260812 00:33:32.594455 393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:32.596143 32702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } }
I20260812 00:33:32.596592 32702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 649391e0af254948b96a19e6725e375c, State: Initialized, Role: FOLLOWER
I20260812 00:33:32.597121 32702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } }
I20260812 00:33:32.598590 420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.599496 420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:32.599812 32702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:32.600243 32666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:32.603583 32667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "649391e0af254948b96a19e6725e375c"
I20260812 00:33:32.606187 32666 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [term 1 FOLLOWER]: Refusing update from remote peer a165cfeadbdb473fb71b340b3b89e9c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:33:32.608453 402 mvcc.cc:205] Tried to move back new op lower bound from 7317482752177881088 to 7317482751988596736. Current Snapshot: MvccSnapshot[applied={T|T < 7317482752177881088 or (T in {7317482752177881088})}]
I20260812 00:33:32.610602 413 mvcc.cc:205] Tried to move back new op lower bound from 7317482752177881088 to 7317482751988596736. Current Snapshot: MvccSnapshot[applied={T|T < 7317482752177881088}]
I20260812 00:33:32.611095 32667 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a165cfeadbdb473fb71b340b3b89e9c6 in term 1.
I20260812 00:33:32.612509 362 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:33:32.621799 380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.622095 380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:32.648769 393 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:32.650851 393 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:32.655062 420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a165cfeadbdb473fb71b340b3b89e9c6. Latest consensus state: current_term: 1 leader_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.655519 420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:32.655951 432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.656459 432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:32.657775 383 sys_catalog.cc:455] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a165cfeadbdb473fb71b340b3b89e9c6" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 41769 } } peers { permanent_uuid: "649391e0af254948b96a19e6725e375c" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 35195 } } peers { permanent_uuid: "7161807701a14213bcbccb44bfc075a3" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 34395 } } }
I20260812 00:33:32.658077 383 sys_catalog.cc:458] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:32.665906 442 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 00:33:32.672048 393 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a165cfeadbdb473fb71b340b3b89e9c6: Generated new TSK 0
I20260812 00:33:32.673238 393 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 00:33:32.761729 355 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.758185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44396 (local address 127.29.190.190:41769)
0812 00:33:32.758430 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.758437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.759340 (+ 903us) server_negotiation.cc:407] Connection header received
0812 00:33:32.759705 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.759712 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.759801 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.759876 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.761356 (+ 1480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44396: BlockingRecv error: recv got EOF from 127.0.0.1:44396 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 00:33:32.761952 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.758214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34510 (local address 127.29.190.189:35195)
0812 00:33:32.758631 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.758639 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.759558 (+ 919us) server_negotiation.cc:407] Connection header received
0812 00:33:32.759830 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.759836 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.759918 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.759990 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.761701 (+ 1711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34510: BlockingRecv error: recv got EOF from 127.0.0.1:34510 (error 108)
Metrics: {"server-negotiator.queue_time_us":251}
W20260812 00:33:32.763724 354 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.759699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41638 (local address 127.29.190.188:34395)
0812 00:33:32.759883 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.759889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.762131 (+ 2242us) server_negotiation.cc:407] Connection header received
0812 00:33:32.762207 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.762213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.762307 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.762406 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.763411 (+ 1005us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41638: BlockingRecv error: recv got EOF from 127.0.0.1:41638 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 00:33:32.771821 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.767820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34522 (local address 127.29.190.189:35195)
0812 00:33:32.767979 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.767983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.770182 (+ 2199us) server_negotiation.cc:407] Connection header received
0812 00:33:32.770464 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.770478 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.770583 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.770699 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.771561 (+ 862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34522: BlockingRecv error: recv got EOF from 127.0.0.1:34522 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260812 00:33:32.778921 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.777514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34526 (local address 127.29.190.189:35195)
0812 00:33:32.777717 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.777723 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.777742 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:33:32.777806 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.777811 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.777890 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.777996 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.778721 (+ 725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34526: BlockingRecv error: recv got EOF from 127.0.0.1:34526 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 00:33:32.786523 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.784628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34532 (local address 127.29.190.189:35195)
0812 00:33:32.784847 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.784853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.785123 (+ 270us) server_negotiation.cc:407] Connection header received
0812 00:33:32.785307 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.785311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.785375 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.785469 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.786275 (+ 806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34532: BlockingRecv error: recv got EOF from 127.0.0.1:34532 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260812 00:33:32.796008 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.793941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34546 (local address 127.29.190.189:35195)
0812 00:33:32.794186 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.794193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.794640 (+ 447us) server_negotiation.cc:407] Connection header received
0812 00:33:32.794805 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.794810 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.794898 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.795009 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.795773 (+ 764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34546: BlockingRecv error: recv got EOF from 127.0.0.1:34546 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
W20260812 00:33:32.810153 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.808047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34558 (local address 127.29.190.189:35195)
0812 00:33:32.808253 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.808260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.808714 (+ 454us) server_negotiation.cc:407] Connection header received
0812 00:33:32.808896 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.808903 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.809000 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.809139 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.809910 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34558: BlockingRecv error: recv got EOF from 127.0.0.1:34558 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 00:33:32.838434 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.836057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34570 (local address 127.29.190.189:35195)
0812 00:33:32.836246 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.836253 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.836862 (+ 609us) server_negotiation.cc:407] Connection header received
0812 00:33:32.837055 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.837061 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.837186 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.837306 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.838176 (+ 870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34570: BlockingRecv error: recv got EOF from 127.0.0.1:34570 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 00:33:32.876283 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.873944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34572 (local address 127.29.190.189:35195)
0812 00:33:32.874177 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.874185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.874628 (+ 443us) server_negotiation.cc:407] Connection header received
0812 00:33:32.874808 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.874815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.874923 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.875061 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.876005 (+ 944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34572: BlockingRecv error: recv got EOF from 127.0.0.1:34572 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 00:33:32.953907 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:32.951682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34578 (local address 127.29.190.189:35195)
0812 00:33:32.951889 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:32.951896 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:32.952273 (+ 377us) server_negotiation.cc:407] Connection header received
0812 00:33:32.952466 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:32.952472 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:32.952571 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:32.952697 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:32.953660 (+ 963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34578: BlockingRecv error: recv got EOF from 127.0.0.1:34578 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260812 00:33:33.087498 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:33.085516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34588 (local address 127.29.190.189:35195)
0812 00:33:33.085734 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:33.085738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:33.086062 (+ 324us) server_negotiation.cc:407] Connection header received
0812 00:33:33.086235 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:33.086239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:33.086333 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:33.086435 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:33.087210 (+ 775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34588: BlockingRecv error: recv got EOF from 127.0.0.1:34588 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260812 00:33:33.349213 32707 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:33.347204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34600 (local address 127.29.190.189:35195)
0812 00:33:33.347482 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:33.347491 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:33.347681 (+ 190us) server_negotiation.cc:407] Connection header received
0812 00:33:33.347932 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:33.347937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:33.348025 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:33.348158 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:33.348945 (+ 787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34600: BlockingRecv error: recv got EOF from 127.0.0.1:34600 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:33:33.562141 410 catalog_manager.cc:1259] Loaded cluster ID: a232b8eaf4d8466c950deb63f0cf8b8e
I20260812 00:33:33.562289 410 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3: loading cluster ID for follower catalog manager: success
I20260812 00:33:33.565035 410 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3: acquiring CA information for follower catalog manager: success
I20260812 00:33:33.566891 410 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7161807701a14213bcbccb44bfc075a3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:33:33.671348 442 catalog_manager.cc:1259] Loaded cluster ID: a232b8eaf4d8466c950deb63f0cf8b8e
I20260812 00:33:33.671531 442 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c: loading cluster ID for follower catalog manager: success
I20260812 00:33:33.675493 442 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c: acquiring CA information for follower catalog manager: success
I20260812 00:33:33.678159 442 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 649391e0af254948b96a19e6725e375c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:33:33.892884 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:33.871954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34604 (local address 127.29.190.189:35195)
0812 00:33:33.883955 (+ 12001us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:33.883963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:33.884421 (+ 458us) server_negotiation.cc:407] Connection header received
0812 00:33:33.884636 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:33.884643 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:33.884856 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:33.885028 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:33.885631 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.886939 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.889087 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.889867 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.890066 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:33.891231 (+ 1165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:33.892100 (+ 869us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:33.892271 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:33.892400 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 00:33:33.892499 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11839,"thread_start_us":11684,"threads_started":1}
I20260812 00:33:33.920472 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:33.905202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41650 (local address 127.29.190.188:34395)
0812 00:33:33.912005 (+ 6803us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:33.912015 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:33.912390 (+ 375us) server_negotiation.cc:407] Connection header received
0812 00:33:33.912645 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:33.912651 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:33.912851 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:33.913054 (+ 203us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:33.913653 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.915010 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.917156 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.917976 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.918102 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:33.918798 (+ 696us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:33.919577 (+ 779us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:33.919775 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:33.919851 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 00:33:33.919977 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6633,"thread_start_us":6446,"threads_started":1}
I20260812 00:33:33.959367 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:33.933456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34616 (local address 127.29.190.189:35195)
0812 00:33:33.933657 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:33.933665 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:33.952083 (+ 18418us) server_negotiation.cc:407] Connection header received
0812 00:33:33.952364 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:33.952369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:33.952465 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:33.952533 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:33.953425 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.954576 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.957140 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.957791 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.957893 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:33.958469 (+ 576us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:33.958609 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:33.958675 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:33.958925 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 00:33:33.959015 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 00:33:33.960290 563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:33.933684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44404 (local address 127.29.190.190:41769)
0812 00:33:33.950846 (+ 17162us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:33.950855 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:33.951859 (+ 1004us) server_negotiation.cc:407] Connection header received
0812 00:33:33.952007 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:33.952016 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:33.952257 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:33.952447 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:33.953397 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.954546 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.957031 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.957672 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.957796 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:33.958492 (+ 696us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:33.958970 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:33.959070 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:33.959906 (+ 836us) server_negotiation.cc:299] Negotiation successful
0812 00:33:33.960006 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16981,"thread_start_us":16863,"threads_started":1}
I20260812 00:33:33.965577 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32501
I20260812 00:33:33.966171 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:33.952377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.29.190.188:34395)
0812 00:33:33.952570 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:33.952577 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:33.959718 (+ 7141us) server_negotiation.cc:407] Connection header received
0812 00:33:33.959874 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:33.959882 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:33.959987 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:33.960107 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:33.960724 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.961836 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.963948 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:33.964554 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:33.964692 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:33.965273 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:33.965414 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:33.965485 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:33.965743 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 00:33:33.965837 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 00:33:33.966693 32586 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:34.112620 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32501
I20260812 00:33:34.158854 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32612
I20260812 00:33:34.160812 32695 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:34.315542 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32612
I20260812 00:33:34.358731 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 32710
I20260812 00:33:34.360538 343 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:34.517935 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 32710
2026-08-12T00:33:34Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5490 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 00:33:34 dist-test-slave-c12x krb5kdc[573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 00:33:34 dist-test-slave-c12x krb5kdc[573](info): set up 2 sockets
Aug 12 00:33:34 dist-test-slave-c12x krb5kdc[573](info): commencing operation
krb5kdc: starting...
W20260812 00:33:36.264012 30458 mini_kdc.cc:121] Time spent starting KDC: real 1.666s user 0.003s sys 0.084s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/test-user.keytab.
Aug 12 00:33:36 dist-test-slave-c12x krb5kdc[573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T00:33:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T00:33:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.190.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
Entry for principal kudu/127.29.190.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab.
I20260812 00:33:36.604940 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:35609
--webserver_interface=127.29.190.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:39571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:35609,127.29.190.189:46125,127.29.190.188:42227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 00:33:36.975721 588 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:33:36.976137 588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:36.976274 588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:36.976428 588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:36.984232 588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:36.984359 588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:36.984508 588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:36.984596 588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:36.984717 588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:36.997170 588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:35609,127.29.190.189:46125,127.29.190.188:42227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.190.keytab
--principal=kudu/127.29.190.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.190:35609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.190.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:36.998733 588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:37.000233 588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:37.013684 598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:37.013736 593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:37.013779 596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:37.014925 588 server_base.cc:1034] running on GCE node
I20260812 00:33:37.015928 588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:37.017518 588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:37.018748 588 hybrid_clock.cc:648] HybridClock initialized: now 1786494817018681 us; error 34 us; skew 500 ppm
I20260812 00:33:37.019124 588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:37 dist-test-slave-c12x krb5kdc[573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494817, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:37.026031 588 init.cc:377] Logged in from keytab as kudu/127.29.190.190@KRBTEST.COM (short username kudu)
I20260812 00:33:37.027793 588 webserver.cc:460] Webserver started at http://127.29.190.190:40889/ using document root <none> and password file <none>
I20260812 00:33:37.028510 588 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:37.028604 588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:37.028867 588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:37.032002 588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/data/instance:
uuid: "e451ae5bcf7f4d20b792366f7cb0bc81"
format_stamp: "Formatted at 2026-08-12 00:33:37 on dist-test-slave-c12x"
server_key: "9c5fc16ee4b523ccc26bad7f3fff0f80"
server_key_iv: "4150d199efd8574783bbe066321d1ced"
server_key_version: "encryptionkey@0"
I20260812 00:33:37.032784 588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/wal/instance:
uuid: "e451ae5bcf7f4d20b792366f7cb0bc81"
format_stamp: "Formatted at 2026-08-12 00:33:37 on dist-test-slave-c12x"
server_key: "9c5fc16ee4b523ccc26bad7f3fff0f80"
server_key_iv: "4150d199efd8574783bbe066321d1ced"
server_key_version: "encryptionkey@0"
I20260812 00:33:37.038367 588 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260812 00:33:37.042117 606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:37.043581 588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:33:37.043776 588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/wal
uuid: "e451ae5bcf7f4d20b792366f7cb0bc81"
format_stamp: "Formatted at 2026-08-12 00:33:37 on dist-test-slave-c12x"
server_key: "9c5fc16ee4b523ccc26bad7f3fff0f80"
server_key_iv: "4150d199efd8574783bbe066321d1ced"
server_key_version: "encryptionkey@0"
I20260812 00:33:37.044029 588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:37.058812 588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:37.062963 588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:37.063264 588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:37.083323 588 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.190:35609
I20260812 00:33:37.083364 672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.190:35609 every 8 connection(s)
I20260812 00:33:37.084808 588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/data/info.pb
I20260812 00:33:37.089815 674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:37.090608 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 588
I20260812 00:33:37.090768 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-0/wal/instance
I20260812 00:33:37.091315 30458 external_mini_cluster.cc:1428] Setting key b675eb44ce9f09e6e841875515d525aa
I20260812 00:33:37.106194 674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:33:37 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494817, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.190.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.189@KRBTEST.COM" created.
I20260812 00:33:37.131793 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.110164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:35609 (local address 127.0.0.1:46444)
0812 00:33:37.111115 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.111161 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:37.113172 (+ 2011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:37.114017 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:37.114027 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:37.114741 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:37.115090 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:37.115109 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.116837 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.116848 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:37.117971 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:37.117985 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.118957 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.118964 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:37.119162 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:37.119942 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:37.119965 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:37.123021 (+ 3056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:37.126597 (+ 3576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:37.126609 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:37.126620 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:37.127355 (+ 735us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:37.127879 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:37.127884 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:37.127888 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:37.128074 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:37.128937 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:37.128953 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:37.129217 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 00:33:37.129507 (+ 290us) client_negotiation.cc:240] Negotiation successful
0812 00:33:37.130182 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":167,"thread_start_us":430,"threads_started":1}
I20260812 00:33:37.131815 679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.110178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46444 (local address 127.29.190.190:35609)
0812 00:33:37.111911 (+ 1733us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:37.111920 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:37.111973 (+ 53us) server_negotiation.cc:407] Connection header received
0812 00:33:37.113545 (+ 1572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:37.113551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:37.113770 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:37.113972 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:37.115320 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.116664 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.118129 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.118711 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.118919 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:37.123307 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:37.123316 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:37.123328 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:37.123362 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:37.126439 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:37.127574 (+ 1135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:37.127581 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:37.127584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:37.127740 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:37.128206 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:37.128219 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:37.128221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:37.128776 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:37.129025 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:37.129648 (+ 623us) server_negotiation.cc:299] Negotiation successful
0812 00:33:37.130041 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1532,"spinlock_wait_cycles":17664,"thread_start_us":1313,"threads_started":1}
I20260812 00:33:37.135286 674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:37.136739 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.136185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59816)
0812 00:33:37.136416 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.136563 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260812 00:33:37.137116 609 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
I20260812 00:33:37.139093 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.138605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59820)
0812 00:33:37.138819 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.138915 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 00:33:37.139366 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:46125: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab.
Entry for principal kudu/127.29.190.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab.
I20260812 00:33:37.164978 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.189:46125
--webserver_interface=127.29.190.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab
--principal=kudu/127.29.190.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:39571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:35609,127.29.190.189:46125,127.29.190.188:42227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:33:37.188879 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } attempt: 1
I20260812 00:33:37.190361 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.189725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59822)
0812 00:33:37.189990 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.190160 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260812 00:33:37.191633 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.191112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59838)
0812 00:33:37.191301 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.191405 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 00:33:37.191841 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:46125: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
I20260812 00:33:37.260164 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } attempt: 2
I20260812 00:33:37.261613 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.261000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59842)
0812 00:33:37.261291 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.261410 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 00:33:37.262889 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.262311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59850)
0812 00:33:37.262567 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.262695 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 00:33:37.263124 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:46125: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
I20260812 00:33:37.354439 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } attempt: 3
I20260812 00:33:37.355854 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.355244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59864)
0812 00:33:37.355539 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.355667 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260812 00:33:37.357133 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.356661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59870)
0812 00:33:37.356839 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.356938 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 00:33:37.357385 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:46125: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
I20260812 00:33:37.500705 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } attempt: 4
I20260812 00:33:37.502135 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.501438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59872)
0812 00:33:37.501825 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.501947 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200}
I20260812 00:33:37.503381 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.502902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59888)
0812 00:33:37.503071 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.503189 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 00:33:37.503623 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.189:46125: Network error: Client connection negotiation failed: client connection to 127.29.190.189:46125: connect: Connection refused (error 111)
W20260812 00:33:37.533943 684 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:33:37.534456 684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:37.534557 684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:37.534684 684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:37.542620 684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:37.542716 684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:37.542814 684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:37.542891 684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:37.542976 684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:37.553500 684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:35609,127.29.190.189:46125,127.29.190.188:42227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.189.keytab
--principal=kudu/127.29.190.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.189:46125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.190.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:37.554963 684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:37.556429 684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:37.569190 694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:37.569150 693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:37.569272 696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:37.569531 684 server_base.cc:1034] running on GCE node
I20260812 00:33:37.570603 684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:37.572166 684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:37.573426 684 hybrid_clock.cc:648] HybridClock initialized: now 1786494817573347 us; error 54 us; skew 500 ppm
I20260812 00:33:37.573769 684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:37 dist-test-slave-c12x krb5kdc[573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494817, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:37.577281 684 init.cc:377] Logged in from keytab as kudu/127.29.190.189@KRBTEST.COM (short username kudu)
I20260812 00:33:37.578948 684 webserver.cc:460] Webserver started at http://127.29.190.189:45147/ using document root <none> and password file <none>
I20260812 00:33:37.579798 684 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:37.579939 684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:37.580287 684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:37.583495 684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/data/instance:
uuid: "787fea8fb71b4e818e69e0806d79b409"
format_stamp: "Formatted at 2026-08-12 00:33:37 on dist-test-slave-c12x"
server_key: "0fae0859db7ade0e30ffee5eaf75dc98"
server_key_iv: "6b2bdc0c5899ebafa8e80284f5af6d9f"
server_key_version: "encryptionkey@0"
I20260812 00:33:37.584378 684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/wal/instance:
uuid: "787fea8fb71b4e818e69e0806d79b409"
format_stamp: "Formatted at 2026-08-12 00:33:37 on dist-test-slave-c12x"
server_key: "0fae0859db7ade0e30ffee5eaf75dc98"
server_key_iv: "6b2bdc0c5899ebafa8e80284f5af6d9f"
server_key_version: "encryptionkey@0"
I20260812 00:33:37.589918 684 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 00:33:37.593851 704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:37.595302 684 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 00:33:37.595541 684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/wal
uuid: "787fea8fb71b4e818e69e0806d79b409"
format_stamp: "Formatted at 2026-08-12 00:33:37 on dist-test-slave-c12x"
server_key: "0fae0859db7ade0e30ffee5eaf75dc98"
server_key_iv: "6b2bdc0c5899ebafa8e80284f5af6d9f"
server_key_version: "encryptionkey@0"
I20260812 00:33:37.595803 684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:37.610759 684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:37.616017 684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:37.616386 684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:37.638757 684 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.189:46125
I20260812 00:33:37.638885 778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.189:46125 every 8 connection(s)
I20260812 00:33:37.640295 684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/data/info.pb
I20260812 00:33:37.644260 779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:37.649317 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 684
I20260812 00:33:37.649506 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-1/wal/instance
I20260812 00:33:37.649951 30458 external_mini_cluster.cc:1428] Setting key 25842273f150f4241ad5c474855ff6b2
I20260812 00:33:37.650954 779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:33:37 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494817, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:33:37.672976 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.653600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46452 (local address 127.29.190.190:35609)
0812 00:33:37.654105 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:37.654109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:37.655119 (+ 1010us) server_negotiation.cc:407] Connection header received
0812 00:33:37.657152 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:37.657158 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:37.657253 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:37.657379 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:37.658952 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.659763 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.661298 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.661711 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.661844 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:37.665637 (+ 3793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:37.665647 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:37.665654 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:37.665715 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:37.669510 (+ 3795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:37.670258 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:37.670267 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:37.670273 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:37.670427 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:37.670848 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:37.670855 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:37.670861 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:37.671280 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:37.671505 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:37.672207 (+ 702us) server_negotiation.cc:299] Negotiation successful
0812 00:33:37.672461 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":295,"threads_started":1}
I20260812 00:33:37.673591 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.654151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:35609 (local address 127.0.0.1:46452)
0812 00:33:37.654956 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.654994 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:37.656862 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:37.657635 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:37.657643 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:37.658168 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:37.658711 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:37.658728 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.659932 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.659937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:37.661125 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:37.661137 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.661952 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.661960 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:37.662191 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:37.662906 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:37.662934 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:37.665382 (+ 2448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:37.669665 (+ 4283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:37.669672 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:37.669686 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:37.670125 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:37.670538 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:37.670541 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:37.670543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:37.670736 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:37.671414 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:37.671421 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:37.671828 (+ 407us) client_negotiation.cc:769] Sending connection context
0812 00:33:37.672070 (+ 242us) client_negotiation.cc:240] Negotiation successful
0812 00:33:37.672449 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":336,"threads_started":1}
I20260812 00:33:37.675477 779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.29.190.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.190.188@KRBTEST.COM" created.
Aug 12 00:33:37 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494817, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:33:37.693238 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.676284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59890)
0812 00:33:37.676454 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.676476 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:37.676579 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:37.677712 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:37.677716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:37.678175 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:37.678311 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:37.678320 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.679853 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.679859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:37.680696 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:37.680707 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.681512 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.681517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:37.681746 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:37.682414 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:37.682446 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:37.685978 (+ 3532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:37.690544 (+ 4566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:37.690549 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:37.690552 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:37.690954 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:37.691490 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:37.691507 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:37.691513 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:37.691654 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:37.692495 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:37.692499 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:37.692622 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 00:33:37.692748 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 00:33:37.692960 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":44}
I20260812 00:33:37.693712 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.676569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59890 (local address 127.29.190.189:46125)
0812 00:33:37.677297 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:37.677303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:37.677329 (+ 26us) server_negotiation.cc:407] Connection header received
0812 00:33:37.677370 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:37.677376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:37.677543 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:37.677718 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:37.678491 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.679714 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.680836 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.681368 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.681503 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:37.686226 (+ 4723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:37.686243 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:37.686265 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:37.686311 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:37.690381 (+ 4070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:37.691101 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:37.691113 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:37.691119 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:37.691271 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:37.691768 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:37.691775 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:37.691781 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:37.692303 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:37.692504 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:37.692955 (+ 451us) server_negotiation.cc:299] Negotiation successful
0812 00:33:37.693258 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":581,"thread_start_us":408,"threads_started":1}
I20260812 00:33:37.696506 779 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:37.697862 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.697271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55908)
0812 00:33:37.697501 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.697655 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260812 00:33:37.698186 710 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
I20260812 00:33:37.699864 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.699536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55920)
0812 00:33:37.699685 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.699763 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 00:33:37.700143 779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.190.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab.
Entry for principal kudu/127.29.190.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab.
I20260812 00:33:37.724208 30458 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXieYLm/build/asan/bin/kudu
/tmp/dist-test-taskXieYLm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.188:42227
--webserver_interface=127.29.190.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab
--principal=kudu/127.29.190.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.190.148:39571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.190.190:35609,127.29.190.189:46125,127.29.190.188:42227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 00:33:37.749433 779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 1
I20260812 00:33:37.750753 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.750261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55924)
0812 00:33:37.750477 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.750603 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 00:33:37.751796 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.751397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55940)
0812 00:33:37.751607 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.751687 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260812 00:33:37.752012 779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
I20260812 00:33:37.802918 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } attempt: 5
Aug 12 00:33:37 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494817, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:33:37.819657 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.803763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59894)
0812 00:33:37.804051 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.804078 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:37.804229 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:37.804794 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:37.804798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:37.805239 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:37.805446 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:37.805461 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.806962 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.806967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:37.808118 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:37.808136 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.809246 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.809251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:37.809453 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:37.810238 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:37.810265 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:37.812773 (+ 2508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:37.816484 (+ 3711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:37.816492 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:37.816498 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:37.817192 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:37.817646 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:37.817651 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:37.817654 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:37.817848 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:37.818537 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:37.818542 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:37.818730 (+ 188us) client_negotiation.cc:769] Sending connection context
0812 00:33:37.818903 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 00:33:37.819256 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92}
I20260812 00:33:37.819703 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.804044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59894 (local address 127.29.190.189:46125)
0812 00:33:37.804327 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:37.804336 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:37.804364 (+ 28us) server_negotiation.cc:407] Connection header received
0812 00:33:37.804446 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:37.804453 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:37.804563 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:37.804697 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:37.805642 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.806760 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.808320 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:37.809049 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:37.809203 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:37.813009 (+ 3806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:37.813014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:37.813017 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:37.813052 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:37.816309 (+ 3257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:37.817347 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:37.817352 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:37.817354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:37.817516 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:37.818012 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:37.818017 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:37.818019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:37.818357 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:37.818535 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:37.819112 (+ 577us) server_negotiation.cc:299] Negotiation successful
0812 00:33:37.819322 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260812 00:33:37.820225 779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 2
I20260812 00:33:37.821336 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.820880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55942)
0812 00:33:37.821094 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.821195 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 00:33:37.821930 674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:37.822610 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.822177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55944)
0812 00:33:37.822363 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.822478 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 00:33:37.822932 779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
I20260812 00:33:37.823129 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.822647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55946)
0812 00:33:37.822866 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.822952 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260812 00:33:37.824206 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.823830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55956)
0812 00:33:37.824018 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.824107 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260812 00:33:37.824496 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
I20260812 00:33:37.875785 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 1
I20260812 00:33:37.877101 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.876605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55958)
0812 00:33:37.876818 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.876923 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 00:33:37.878185 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.877855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55974)
0812 00:33:37.878008 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.878086 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 00:33:37.878476 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
I20260812 00:33:37.914223 779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 3
I20260812 00:33:37.915664 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.914962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55990)
0812 00:33:37.915224 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.915409 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 00:33:37.916914 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.916410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:55996)
0812 00:33:37.916664 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.916769 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
W20260812 00:33:37.917176 779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
I20260812 00:33:37.946749 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 2
I20260812 00:33:37.948200 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.947620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56002)
0812 00:33:37.947873 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.948021 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 00:33:37.949515 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:37.949004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56016)
0812 00:33:37.949259 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:37.949364 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 00:33:37.949780 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
I20260812 00:33:38.056077 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 3
I20260812 00:33:38.057348 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.056839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56018)
0812 00:33:38.057066 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.057174 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 00:33:38.058554 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.058118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56022)
0812 00:33:38.058338 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.058423 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 00:33:38.058780 674 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
I20260812 00:33:38.060462 779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 4
I20260812 00:33:38.061717 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.061108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56026)
0812 00:33:38.061394 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.061514 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 00:33:38.062853 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.062435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56034)
0812 00:33:38.062600 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.062704 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 00:33:38.063087 779 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.190.188:42227: Network error: Client connection negotiation failed: client connection to 127.29.190.188:42227: connect: Connection refused (error 111)
W20260812 00:33:38.100078 789 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 00:33:38.100416 789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 00:33:38.100540 789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 00:33:38.100697 789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 00:33:38.108170 789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 00:33:38.108258 789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 00:33:38.108320 789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 00:33:38.108371 789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 00:33:38.108433 789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 00:33:38.118424 789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.190.148:39571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.190.190:35609,127.29.190.189:46125,127.29.190.188:42227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/krb5kdc/kudu_127.29.190.188.keytab
--principal=kudu/127.29.190.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.190.188:42227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.190.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 22:51:51 UTC on ccycloud.quasar-sbbrqv.root.comops.site
build id 4581606
ASAN enabled
I20260812 00:33:38.119791 789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 00:33:38.121121 789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 00:33:38.133394 795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:38.133476 796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 00:33:38.133443 798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 00:33:38.134763 789 server_base.cc:1034] running on GCE node
I20260812 00:33:38.135728 789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 00:33:38.137359 789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 00:33:38.138614 789 hybrid_clock.cc:648] HybridClock initialized: now 1786494818138535 us; error 57 us; skew 500 ppm
I20260812 00:33:38.138954 789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494818, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 00:33:38.142354 789 init.cc:377] Logged in from keytab as kudu/127.29.190.188@KRBTEST.COM (short username kudu)
I20260812 00:33:38.144076 789 webserver.cc:460] Webserver started at http://127.29.190.188:45249/ using document root <none> and password file <none>
I20260812 00:33:38.144877 789 fs_manager.cc:359] Metadata directory not provided
I20260812 00:33:38.145030 789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 00:33:38.145378 789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 00:33:38.148695 789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/data/instance:
uuid: "2778e789778d4aa792434aa80e494505"
format_stamp: "Formatted at 2026-08-12 00:33:38 on dist-test-slave-c12x"
server_key: "1a4064f437297312e500dc3bf64bf113"
server_key_iv: "3cb8d5d775fb1062e065099e683ffa5b"
server_key_version: "encryptionkey@0"
I20260812 00:33:38.149657 789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/wal/instance:
uuid: "2778e789778d4aa792434aa80e494505"
format_stamp: "Formatted at 2026-08-12 00:33:38 on dist-test-slave-c12x"
server_key: "1a4064f437297312e500dc3bf64bf113"
server_key_iv: "3cb8d5d775fb1062e065099e683ffa5b"
server_key_version: "encryptionkey@0"
I20260812 00:33:38.155011 789 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 00:33:38.158977 809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 00:33:38.160609 789 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 00:33:38.160871 789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/data,/tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/wal
uuid: "2778e789778d4aa792434aa80e494505"
format_stamp: "Formatted at 2026-08-12 00:33:38 on dist-test-slave-c12x"
server_key: "1a4064f437297312e500dc3bf64bf113"
server_key_iv: "3cb8d5d775fb1062e065099e683ffa5b"
server_key_version: "encryptionkey@0"
I20260812 00:33:38.161154 789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 00:33:38.209723 789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 00:33:38.214570 789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 00:33:38.214888 789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 00:33:38.234629 789 rpc_server.cc:307] RPC server started. Bound to: 127.29.190.188:42227
I20260812 00:33:38.234648 882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.190.188:42227 every 8 connection(s)
I20260812 00:33:38.235996 674 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 4
I20260812 00:33:38.236284 789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/data/info.pb
I20260812 00:33:38.239224 30458 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXieYLm/build/asan/bin/kudu as pid 789
I20260812 00:33:38.239460 30458 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXieYLm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786494426716583-30458-0/minicluster-data/master-2/wal/instance
I20260812 00:33:38.240549 30458 external_mini_cluster.cc:1428] Setting key 306a4ede1d035938cf2af611dc61db39
I20260812 00:33:38.242794 883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 00:33:38.252147 883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494817, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.190@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
I20260812 00:33:38.262596 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.236749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56044)
0812 00:33:38.237027 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.237057 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:38.237223 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:38.242740 (+ 5517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:38.242750 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:38.243356 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:38.243771 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.243790 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.246331 (+ 2541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.246341 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.248321 (+ 1980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.248344 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.249900 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.249909 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.250199 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.251012 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:38.251046 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:38.254000 (+ 2954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:38.259378 (+ 5378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.259383 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.259387 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.259923 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.260400 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.260404 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.260406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.260529 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.261437 (+ 908us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:38.261444 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:38.261668 (+ 224us) client_negotiation.cc:769] Sending connection context
0812 00:33:38.261847 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 00:33:38.262200 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
I20260812 00:33:38.264117 884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.237728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56044 (local address 127.29.190.188:42227)
0812 00:33:38.238690 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.238713 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.238777 (+ 64us) server_negotiation.cc:407] Connection header received
0812 00:33:38.241300 (+ 2523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.241331 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.241850 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.242277 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.243971 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.246112 (+ 2141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.248509 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.249714 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.249902 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.254413 (+ 4511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.254429 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.254449 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.254495 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.259241 (+ 4746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.260064 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.260073 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.260081 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.260260 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.260657 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.260662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.260666 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.261239 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.261433 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.262156 (+ 723us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.262645 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":399,"threads_started":1}
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494818, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:33:38.271706 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.242282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56048 (local address 127.29.190.188:42227)
0812 00:33:38.252006 (+ 9724us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.252011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.252036 (+ 25us) server_negotiation.cc:407] Connection header received
0812 00:33:38.252087 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.252092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.252177 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.252297 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.254325 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.256669 (+ 2344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.258664 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.259390 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.259590 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.264994 (+ 5404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.265000 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.265005 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.265040 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.268430 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.269367 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.269373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.269377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.269519 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.269992 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.269998 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.270003 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.270361 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.270639 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.271034 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.271261 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9564,"spinlock_wait_cycles":19840,"thread_start_us":9347,"threads_started":1}
I20260812 00:33:38.272980 674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81: Bootstrap starting.
I20260812 00:33:38.273226 893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.255139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.190:35609 (local address 127.0.0.1:46468)
0812 00:33:38.256315 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.256372 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:38.256546 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:38.256971 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:38.256979 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:38.257691 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:38.257967 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.257977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.259241 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.259247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.261131 (+ 1884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.261150 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.262271 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.262277 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.262461 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.263204 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:38.263227 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:38.266144 (+ 2917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:38.270006 (+ 3862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.270020 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.270026 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.270453 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.270944 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.270948 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.270951 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.271109 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.272014 (+ 905us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:38.272023 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:38.272242 (+ 219us) client_negotiation.cc:769] Sending connection context
0812 00:33:38.272446 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 00:33:38.272804 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"thread_start_us":679,"threads_started":1}
I20260812 00:33:38.273283 892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.255064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46468 (local address 127.29.190.190:35609)
0812 00:33:38.255652 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.255659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.256493 (+ 834us) server_negotiation.cc:407] Connection header received
0812 00:33:38.256697 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.256702 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.256789 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.256924 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.258135 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.259014 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.261309 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.261897 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.262022 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.266385 (+ 4363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.266393 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.266400 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.266444 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.269857 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.270621 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.270627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.270630 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.270780 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.271250 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.271258 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.271262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.271716 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.271902 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.272591 (+ 689us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.272823 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":815,"threads_started":1}
I20260812 00:33:38.274698 883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:38.277952 674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:38.279328 674 log.cc:824] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81: Log is configured to *not* fsync() on all Append() calls
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.190@KRBTEST.COM
I20260812 00:33:38.283330 674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81: No bootstrap required, opened a new log
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494818, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:33:38.290850 893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.275477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.189:46125 (local address 127.0.0.1:59898)
0812 00:33:38.275652 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.275672 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:38.275767 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:38.276277 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:38.276282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:38.276731 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:38.276938 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.276952 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.278408 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.278413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.279742 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.279759 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.280977 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.280983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.281178 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.281777 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:38.281799 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:38.284401 (+ 2602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:38.288159 (+ 3758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.288165 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.288169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.288571 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.288979 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.288984 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.288988 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.289152 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.289801 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:38.289805 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:38.289973 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 00:33:38.290146 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 00:33:38.290444 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 00:33:38.291427 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.275564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59898 (local address 127.29.190.189:46125)
0812 00:33:38.275763 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.275768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.275787 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:33:38.275891 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.275897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.275979 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.276052 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.277152 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.278185 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.279940 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.280623 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.280724 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.284621 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.284628 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.284632 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.284675 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.288000 (+ 3325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.288721 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.288726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.288728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.288856 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.289283 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.289287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.289289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.289562 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.289727 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.290306 (+ 579us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.290546 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:33:38.292421 883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } has no permanent_uuid. Determining permanent_uuid...
I20260812 00:33:38.293744 896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.274177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46472 (local address 127.29.190.190:35609)
0812 00:33:38.275338 (+ 1161us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.275345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.275368 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:33:38.275417 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.275422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.275529 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.275695 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.276962 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.277857 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.279142 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.279693 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.279834 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.285511 (+ 5677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.285523 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.285528 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.285576 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.289533 (+ 3957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.290432 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.290437 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.290441 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.290645 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.291123 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.291128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.291131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.291559 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.291808 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.292998 (+ 1190us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.293236 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":993,"thread_start_us":747,"threads_started":1}
I20260812 00:33:38.295614 674 raft_consensus.cc:348] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } }
I20260812 00:33:38.296072 674 raft_consensus.cc:729] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e451ae5bcf7f4d20b792366f7cb0bc81, State: Initialized, Role: FOLLOWER
I20260812 00:33:38.296677 674 consensus_queue.cc:260] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } }
I20260812 00:33:38.297710 900 sys_catalog.cc:455] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.298207 900 sys_catalog.cc:458] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:38.299139 674 sys_catalog.cc:564] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494818, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.188@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.190.189@KRBTEST.COM
I20260812 00:33:38.310264 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.293355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56054 (local address 127.29.190.188:42227)
0812 00:33:38.293540 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.293546 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.293629 (+ 83us) server_negotiation.cc:407] Connection header received
0812 00:33:38.293786 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.293794 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.293888 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.293991 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.294938 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.295888 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.297646 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.298367 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.298466 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.302371 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.302381 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.302389 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.302443 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.306819 (+ 4376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.307725 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.307730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.307733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.307884 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.308353 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.308358 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.308361 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.308823 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.308964 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.309636 (+ 672us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.309897 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 00:33:38.311353 893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.293284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56054)
0812 00:33:38.293536 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.293555 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:38.293668 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:38.294167 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:38.294172 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:38.294554 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:38.294747 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.294763 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.296015 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.296023 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.297476 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.297497 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.298705 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.298711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.298914 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.299648 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:38.299675 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:38.302141 (+ 2466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:38.306992 (+ 4851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.307000 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.307007 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.307594 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.308034 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.308040 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.308044 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.308225 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.309065 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:38.309073 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:38.309293 (+ 220us) client_negotiation.cc:769] Sending connection context
0812 00:33:38.310677 (+ 1384us) client_negotiation.cc:240] Negotiation successful
0812 00:33:38.311005 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133}
I20260812 00:33:38.314679 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.295653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59910 (local address 127.29.190.189:46125)
0812 00:33:38.295831 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.295836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.296260 (+ 424us) server_negotiation.cc:407] Connection header received
0812 00:33:38.296426 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.296430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.296512 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.296618 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.298338 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.299535 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.301746 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.302396 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.302535 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.307218 (+ 4683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.307224 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.307229 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.307274 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.311041 (+ 3767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.312052 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.312058 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.312061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.312269 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.312803 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.312808 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.312811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.313205 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.313482 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.314087 (+ 605us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.314346 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260812 00:33:38.316301 612 tablet.cc:2369] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 00:33:38.318214 883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505: Bootstrap starting.
I20260812 00:33:38.320827 30458 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 00:33:38.322363 883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:38.323323 639 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46472
I20260812 00:33:38.323820 883 log.cc:824] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:38.323921 639 raft_consensus.cc:482] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 00:33:38.324287 639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:38.316450 588 master_runner.cc:186] Error getting master registration for 127.29.190.189:46125: OK, instance_id { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" instance_seqno: 1786494817633034 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:33:38.328791 588 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:33:38.329413 639 raft_consensus.cc:504] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } }
I20260812 00:33:38.331094 639 leader_election.cc:288] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [CANDIDATE]: Term 1 election: Requested vote from peers 787fea8fb71b4e818e69e0806d79b409 (127.29.190.189:46125), 2778e789778d4aa792434aa80e494505 (127.29.190.188:42227)
I20260812 00:33:38.331880 883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505: No bootstrap required, opened a new log
W20260812 00:33:38.332443 915 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 00:33:38.332711 915 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 00:33:38.345049 883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } }
I20260812 00:33:38.345683 883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2778e789778d4aa792434aa80e494505, State: Initialized, Role: FOLLOWER
I20260812 00:33:38.346349 883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } }
I20260812 00:33:38.358400 932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.358870 932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:38.360203 896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.339236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46474 (local address 127.29.190.190:35609)
0812 00:33:38.339510 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.339517 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.340434 (+ 917us) server_negotiation.cc:407] Connection header received
0812 00:33:38.340753 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.340761 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.340850 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.340951 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.343530 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.344738 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.346790 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.347540 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.347666 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.351610 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.351617 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.351623 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.351669 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.355757 (+ 4088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.357265 (+ 1508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.357272 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.357277 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.357472 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.358051 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.358059 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.358063 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.358514 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.358753 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.359471 (+ 718us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.359781 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 00:33:38.360987 883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:38.361265 850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2778e789778d4aa792434aa80e494505"
I20260812 00:33:38.361826 850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:38.362311 779 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } attempt: 5
I20260812 00:33:38.371135 850 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e451ae5bcf7f4d20b792366f7cb0bc81 in term 1.
I20260812 00:33:38.373251 609 leader_election.cc:302] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2778e789778d4aa792434aa80e494505, e451ae5bcf7f4d20b792366f7cb0bc81; no voters:
Aug 12 00:33:38 dist-test-slave-c12x krb5kdc[573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786494817, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.190.189@KRBTEST.COM for kudu/127.29.190.188@KRBTEST.COM
I20260812 00:33:38.373986 900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 00:33:38.374765 900 raft_consensus.cc:686] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [term 1 LEADER]: Becoming Leader. State: Replica: e451ae5bcf7f4d20b792366f7cb0bc81, State: Running, Role: LEADER
I20260812 00:33:38.375427 900 consensus_queue.cc:237] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } }
I20260812 00:33:38.379659 934 sys_catalog.cc:455] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e451ae5bcf7f4d20b792366f7cb0bc81. Latest consensus state: current_term: 1 leader_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.380111 934 sys_catalog.cc:458] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:38.382658 939 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 00:33:38.383960 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.362939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.190.188:42227 (local address 127.0.0.1:56080)
0812 00:33:38.363215 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 00:33:38.363232 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 00:33:38.363319 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 00:33:38.364151 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 00:33:38.364158 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 00:33:38.364773 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0812 00:33:38.365004 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.365017 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.366694 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.366701 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.368343 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 00:33:38.368362 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.370055 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.370063 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 00:33:38.370338 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.371230 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 00:33:38.371257 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 00:33:38.374375 (+ 3118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 00:33:38.380679 (+ 6304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.380688 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.380693 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.381251 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.381773 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 00:33:38.381779 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 00:33:38.381783 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 00:33:38.381989 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 00:33:38.382869 (+ 880us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 00:33:38.382875 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 00:33:38.383048 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 00:33:38.383220 (+ 172us) client_negotiation.cc:240] Negotiation successful
0812 00:33:38.383569 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260812 00:33:38.385123 884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.363025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56080 (local address 127.29.190.188:42227)
0812 00:33:38.363578 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.363585 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.363608 (+ 23us) server_negotiation.cc:407] Connection header received
0812 00:33:38.363669 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.363675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.363765 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.363872 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.365209 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.366506 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.368555 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.369359 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.369563 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.374626 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.374636 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.374644 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.374687 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.378592 (+ 3905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.381420 (+ 2828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.381426 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.381430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.381622 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.382160 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.382165 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.382168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.382615 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.384380 (+ 1765us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.384517 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.384762 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367}
I20260812 00:33:38.385250 939 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 00:33:38.391393 779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409: Bootstrap starting.
I20260812 00:33:38.397168 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.340261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59912 (local address 127.29.190.189:46125)
0812 00:33:38.341914 (+ 1653us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.341920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.344092 (+ 2172us) server_negotiation.cc:407] Connection header received
0812 00:33:38.347302 (+ 3210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.347310 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.347416 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.347559 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.350481 (+ 2922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.351839 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.354135 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.355033 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.355168 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.388980 (+ 33812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.388989 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.388993 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.389053 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.393401 (+ 4348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.394460 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.394468 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.394472 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.394657 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.395179 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.395185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.395189 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.395633 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.395865 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.396535 (+ 670us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.396794 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1491}
I20260812 00:33:38.397965 779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409: Neither blocks nor log segments found. Creating new log.
I20260812 00:33:38.399523 779 log.cc:824] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409: Log is configured to *not* fsync() on all Append() calls
I20260812 00:33:38.406621 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.341121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56068 (local address 127.29.190.188:42227)
0812 00:33:38.341325 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.341333 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.360324 (+ 18991us) server_negotiation.cc:407] Connection header received
0812 00:33:38.369689 (+ 9365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.369694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.369773 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.369866 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.382256 (+ 12390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.383339 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.390219 (+ 6880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.390927 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.391054 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.396692 (+ 5638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 00:33:38.396701 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 00:33:38.396709 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 00:33:38.396753 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 00:33:38.400676 (+ 3923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.402415 (+ 1739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.402424 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.402431 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.402652 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 00:33:38.403565 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 00:33:38.403572 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 00:33:38.403578 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 00:33:38.404067 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 00:33:38.404401 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.405539 (+ 1138us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.405998 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 00:33:38.413458 779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409: No bootstrap required, opened a new log
I20260812 00:33:38.417384 850 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [term 1 FOLLOWER]: Refusing update from remote peer e451ae5bcf7f4d20b792366f7cb0bc81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:33:38.418701 934 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:33:38.444471 779 raft_consensus.cc:348] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } }
I20260812 00:33:38.444922 779 raft_consensus.cc:729] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 787fea8fb71b4e818e69e0806d79b409, State: Initialized, Role: FOLLOWER
I20260812 00:33:38.445425 779 consensus_queue.cc:260] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } }
I20260812 00:33:38.445760 932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e451ae5bcf7f4d20b792366f7cb0bc81. Latest consensus state: current_term: 1 leader_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.446062 932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:38.446832 957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.447724 957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:38.451174 900 sys_catalog.cc:455] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.451556 900 sys_catalog.cc:458] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:38.456243 932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.456518 932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:38.457706 939 catalog_manager.cc:1347] Generated new cluster ID: b99d7e6402c34d709b7dda1e6476c486
I20260812 00:33:38.457823 939 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 00:33:38.458197 779 sys_catalog.cc:564] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 00:33:38.459580 950 mvcc.cc:205] Tried to move back new op lower bound from 7317482776223277056 to 7317482776071983104. Current Snapshot: MvccSnapshot[applied={T|T < 7317482776223277056}]
I20260812 00:33:38.461408 745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [term 0 FOLLOWER]: Advancing to term 1
I20260812 00:33:38.463553 746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "787fea8fb71b4e818e69e0806d79b409"
I20260812 00:33:38.475870 745 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [term 1 FOLLOWER]: Refusing update from remote peer e451ae5bcf7f4d20b792366f7cb0bc81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 00:33:38.480769 746 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e451ae5bcf7f4d20b792366f7cb0bc81 in term 1.
I20260812 00:33:38.488286 934 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 00:33:38.539022 959 catalog_manager.cc:1259] Loaded cluster ID: b99d7e6402c34d709b7dda1e6476c486
I20260812 00:33:38.539808 957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e451ae5bcf7f4d20b792366f7cb0bc81. Latest consensus state: current_term: 1 leader_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.540141 957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:38.541116 970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.541647 970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 00:33:38.543198 900 sys_catalog.cc:455] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e451ae5bcf7f4d20b792366f7cb0bc81" member_type: VOTER last_known_addr { host: "127.29.190.190" port: 35609 } } peers { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" member_type: VOTER last_known_addr { host: "127.29.190.189" port: 46125 } } peers { permanent_uuid: "2778e789778d4aa792434aa80e494505" member_type: VOTER last_known_addr { host: "127.29.190.188" port: 42227 } } }
I20260812 00:33:38.543545 900 sys_catalog.cc:458] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81 [sys.catalog]: This master's current role is: LEADER
I20260812 00:33:38.551194 939 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 00:33:38.553735 939 catalog_manager.cc:1504] Loading token signing keys...
I20260812 00:33:38.525902 789 master_runner.cc:186] Error getting master registration for 127.29.190.189:46125: OK, instance_id { permanent_uuid: "787fea8fb71b4e818e69e0806d79b409" instance_seqno: 1786494817633034 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 00:33:38.557029 959 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505: loading cluster ID for follower catalog manager: success
I20260812 00:33:38.557096 789 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 00:33:38.570413 959 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505: acquiring CA information for follower catalog manager: success
W20260812 00:33:38.582072 959 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260812 00:33:38.594905 939 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e451ae5bcf7f4d20b792366f7cb0bc81: Generated new TSK 0
I20260812 00:33:38.596416 939 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 00:33:38.638434 982 catalog_manager.cc:1259] Loaded cluster ID: b99d7e6402c34d709b7dda1e6476c486
I20260812 00:33:38.638666 982 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409: loading cluster ID for follower catalog manager: success
I20260812 00:33:38.642661 982 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409: acquiring CA information for follower catalog manager: success
I20260812 00:33:38.653936 982 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 787fea8fb71b4e818e69e0806d79b409: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 00:33:38.784636 896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:38.762861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.29.190.190:35609)
0812 00:33:38.763098 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.763106 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.781771 (+ 18665us) server_negotiation.cc:407] Connection header received
0812 00:33:38.782802 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.782809 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.782910 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.782988 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.784321 (+ 1333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46480: BlockingRecv error: recv got EOF from 127.0.0.1:46480 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 00:33:38.786936 786 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:38.769029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59922 (local address 127.29.190.189:46125)
0812 00:33:38.769254 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.769262 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.782472 (+ 13210us) server_negotiation.cc:407] Connection header received
0812 00:33:38.785359 (+ 2887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.785366 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.785453 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.785535 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.786674 (+ 1139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59922: BlockingRecv error: recv got EOF from 127.0.0.1:59922 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260812 00:33:38.790876 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:38.788535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56096 (local address 127.29.190.188:42227)
0812 00:33:38.788755 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.788762 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.789240 (+ 478us) server_negotiation.cc:407] Connection header received
0812 00:33:38.789480 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.789486 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.789586 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.789663 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.790613 (+ 950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56096: BlockingRecv error: recv got EOF from 127.0.0.1:56096 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 00:33:38.846204 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.825359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59924 (local address 127.29.190.189:46125)
0812 00:33:38.825567 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.825575 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.837647 (+ 12072us) server_negotiation.cc:407] Connection header received
0812 00:33:38.838283 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.838290 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.838522 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.838688 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:38.839493 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.840734 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.842901 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.843639 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.843755 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.844600 (+ 845us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:38.845336 (+ 736us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:38.845463 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.845737 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.845848 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 00:33:38.890389 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:38.880057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56110 (local address 127.29.190.188:42227)
0812 00:33:38.880259 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.880266 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.887939 (+ 7673us) server_negotiation.cc:407] Connection header received
0812 00:33:38.888660 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.888667 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.888808 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.888892 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.890095 (+ 1203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56110: BlockingRecv error: recv got EOF from 127.0.0.1:56110 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:33:38.943024 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:38.926406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59940 (local address 127.29.190.189:46125)
0812 00:33:38.926661 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.926668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.934875 (+ 8207us) server_negotiation.cc:407] Connection header received
0812 00:33:38.935533 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.935542 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.935658 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.935737 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:38.936553 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.937808 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.940257 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:38.941004 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:38.941134 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:38.941961 (+ 827us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:38.942173 (+ 212us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:38.942257 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:38.942555 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 00:33:38.942666 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
W20260812 00:33:38.986150 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:38.980613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56116 (local address 127.29.190.188:42227)
0812 00:33:38.980845 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:38.980852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:38.984235 (+ 3383us) server_negotiation.cc:407] Connection header received
0812 00:33:38.984502 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:38.984509 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:38.984633 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:38.984720 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:38.985900 (+ 1180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56116: BlockingRecv error: recv got EOF from 127.0.0.1:56116 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 00:33:39.016415 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.006228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59954 (local address 127.29.190.189:46125)
0812 00:33:39.006464 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.006471 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.007395 (+ 924us) server_negotiation.cc:407] Connection header received
0812 00:33:39.007810 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.007819 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.007931 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.008018 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.008821 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.010121 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.013073 (+ 2952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.014330 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.014527 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.015328 (+ 801us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.015552 (+ 224us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.015625 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.015885 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.016035 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260812 00:33:39.028149 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:39.025376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56130 (local address 127.29.190.188:42227)
0812 00:33:39.025580 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.025598 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.026088 (+ 490us) server_negotiation.cc:407] Connection header received
0812 00:33:39.026411 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.026418 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.026527 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.026624 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:39.027852 (+ 1228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56130: BlockingRecv error: recv got EOF from 127.0.0.1:56130 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:33:39.044653 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.036833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59964 (local address 127.29.190.189:46125)
0812 00:33:39.037049 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.037055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.037812 (+ 757us) server_negotiation.cc:407] Connection header received
0812 00:33:39.038001 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.038008 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.038127 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.038237 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.038826 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.040187 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.042265 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.043042 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.043190 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.043705 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.043868 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.043980 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.044156 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.044250 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260812 00:33:39.057529 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:39.051904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.29.190.188:42227)
0812 00:33:39.052238 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.052245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.055846 (+ 3601us) server_negotiation.cc:407] Connection header received
0812 00:33:39.056057 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.056063 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.056170 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.056299 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:39.057283 (+ 984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56140: BlockingRecv error: recv got EOF from 127.0.0.1:56140 (error 108)
Metrics: {"server-negotiator.queue_time_us":168}
I20260812 00:33:39.078501 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.070394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59966 (local address 127.29.190.189:46125)
0812 00:33:39.070623 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.070630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.071226 (+ 596us) server_negotiation.cc:407] Connection header received
0812 00:33:39.071504 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.071510 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.071614 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.071720 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.072219 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.073359 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.075635 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.076436 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.076567 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.077289 (+ 722us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.077466 (+ 177us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.077575 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.077785 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.077884 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260812 00:33:39.121963 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:39.118103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56152 (local address 127.29.190.188:42227)
0812 00:33:39.118387 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.118397 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.120110 (+ 1713us) server_negotiation.cc:407] Connection header received
0812 00:33:39.120336 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.120343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.120459 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.120586 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:39.121676 (+ 1090us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56152: BlockingRecv error: recv got EOF from 127.0.0.1:56152 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
I20260812 00:33:39.149677 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.142884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59970 (local address 127.29.190.189:46125)
0812 00:33:39.143142 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.143150 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.143632 (+ 482us) server_negotiation.cc:407] Connection header received
0812 00:33:39.143818 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.143826 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.143921 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.144059 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.144507 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.145732 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.147190 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.147912 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.148061 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.148696 (+ 635us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.148895 (+ 199us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.149000 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.149238 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.149344 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260812 00:33:39.159211 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:39.156852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56160 (local address 127.29.190.188:42227)
0812 00:33:39.157133 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.157142 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.157492 (+ 350us) server_negotiation.cc:407] Connection header received
0812 00:33:39.157747 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.157754 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.157855 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.157986 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:39.158922 (+ 936us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56160: BlockingRecv error: recv got EOF from 127.0.0.1:56160 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
I20260812 00:33:39.201479 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.194895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59984 (local address 127.29.190.189:46125)
0812 00:33:39.195166 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.195173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.195600 (+ 427us) server_negotiation.cc:407] Connection header received
0812 00:33:39.195787 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.195794 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.195893 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.196030 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.196433 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.197627 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.199076 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.199868 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.200057 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.200581 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.200713 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.200870 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.201009 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.201091 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260812 00:33:39.210088 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:39.207653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56172 (local address 127.29.190.188:42227)
0812 00:33:39.207860 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.207866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.208383 (+ 517us) server_negotiation.cc:407] Connection header received
0812 00:33:39.208570 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.208574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.208694 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.208822 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:39.209817 (+ 995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56172: BlockingRecv error: recv got EOF from 127.0.0.1:56172 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 00:33:39.283257 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.277971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59994 (local address 127.29.190.189:46125)
0812 00:33:39.278261 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.278268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.278502 (+ 234us) server_negotiation.cc:407] Connection header received
0812 00:33:39.278626 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.278631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.278718 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.278822 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.279242 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.280037 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.281368 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.281818 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.281928 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.282467 (+ 539us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.282580 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.282663 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.282836 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.282920 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
W20260812 00:33:39.292759 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:39.290642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56174 (local address 127.29.190.188:42227)
0812 00:33:39.290906 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.290914 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.291162 (+ 248us) server_negotiation.cc:407] Connection header received
0812 00:33:39.291328 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.291333 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.291513 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.291612 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:39.292453 (+ 841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56174: BlockingRecv error: recv got EOF from 127.0.0.1:56174 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 00:33:39.430498 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.424905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60004 (local address 127.29.190.189:46125)
0812 00:33:39.425193 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.425200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.425546 (+ 346us) server_negotiation.cc:407] Connection header received
0812 00:33:39.425815 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.425819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.425897 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.426018 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.426495 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.427214 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.428698 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.429145 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.429293 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.429719 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.429832 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.429944 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.430093 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.430180 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260812 00:33:39.438514 891 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 00:33:39.436693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56190 (local address 127.29.190.188:42227)
0812 00:33:39.436939 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.436948 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.437067 (+ 119us) server_negotiation.cc:407] Connection header received
0812 00:33:39.437227 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.437232 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.437308 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.437397 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 00:33:39.438212 (+ 815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56190: BlockingRecv error: recv got EOF from 127.0.0.1:56190 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 00:33:39.585175 959 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2778e789778d4aa792434aa80e494505: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 00:33:39.704067 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.698552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60020 (local address 127.29.190.189:46125)
0812 00:33:39.698736 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.698741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.698997 (+ 256us) server_negotiation.cc:407] Connection header received
0812 00:33:39.699214 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.699219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.699295 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.699413 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.699879 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.700747 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.702242 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.702649 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.702753 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.703255 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.703410 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.703510 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.703759 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.703838 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 00:33:39.716588 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.710794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56198 (local address 127.29.190.188:42227)
0812 00:33:39.711065 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.711075 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.711233 (+ 158us) server_negotiation.cc:407] Connection header received
0812 00:33:39.711344 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.711349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.711639 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.711755 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.712157 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.712926 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.714182 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.714620 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.714718 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.715213 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.715902 (+ 689us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.716027 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.716129 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.716213 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 00:33:39.730788 1141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.722468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.29.190.190:35609)
0812 00:33:39.724132 (+ 1664us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.724137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.724156 (+ 19us) server_negotiation.cc:407] Connection header received
0812 00:33:39.724286 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.724291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.724544 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.724751 (+ 207us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.725780 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.726525 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.728212 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.728634 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.728777 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.729492 (+ 715us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.729923 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.730036 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.730210 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.730304 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1510,"thread_start_us":1358,"threads_started":1}
I20260812 00:33:39.730792 891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.723783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56202 (local address 127.29.190.188:42227)
0812 00:33:39.723961 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.723968 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.724414 (+ 446us) server_negotiation.cc:407] Connection header received
0812 00:33:39.724620 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.724625 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.724719 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.724799 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.725747 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.726812 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.728951 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.729418 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.729548 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.729986 (+ 438us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.730115 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.730223 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.730452 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.730544 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 00:33:39.731212 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 00:33:39.722566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60024 (local address 127.29.190.189:46125)
0812 00:33:39.722833 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 00:33:39.722843 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 00:33:39.723702 (+ 859us) server_negotiation.cc:407] Connection header received
0812 00:33:39.724529 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 00:33:39.724537 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 00:33:39.724635 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 00:33:39.724740 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 00:33:39.725367 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.726397 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.728757 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 00:33:39.729429 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 00:33:39.729592 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 00:33:39.730410 (+ 818us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 00:33:39.730525 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 00:33:39.730578 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 00:33:39.730783 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 00:33:39.730863 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 00:33:39.736150 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 588
I20260812 00:33:39.737277 666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:39.849795 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 588
I20260812 00:33:39.880180 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 684
I20260812 00:33:39.881515 774 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:39.990195 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 684
I20260812 00:33:40.016111 30458 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXieYLm/build/asan/bin/kudu pid 789
I20260812 00:33:40.017409 875 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 00:33:40.125767 30458 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXieYLm/build/asan/bin/kudu with pid 789
2026-08-12T00:33:40Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5581 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (11072 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (393380 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST